-- Logs begin at Fri 2022-07-29 03:28:39 UTC, end at Fri 2022-07-29 05:15:10 UTC. -- Jul 29 04:38:24.170035 dv-cinder-851449-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 04:38:24.178873 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 04:38:24 2022] *** Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: nodename: dv-cinder-851449-2-iscsi Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: machine: x86_64 Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: clock source: unix Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: pcre jit disabled Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: detected number of CPU cores: 4 Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: current working directory: / Jul 29 04:38:24.180842 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: detected binary path: /usr/bin/uwsgi-core Jul 29 04:38:24.181603 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: your processes number limit is 47680 Jul 29 04:38:24.181603 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: your memory page size is 4096 bytes Jul 29 04:38:24.181603 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: detected max file descriptor number: 2048 Jul 29 04:38:24.181603 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: lock engine: pthread robust mutexes Jul 29 04:38:24.181603 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: thunder lock: enabled Jul 29 04:38:24.181603 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 04:38:24.181603 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 04:38:24.220357 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: Python main interpreter initialized at 0x556c8e6dd9c0 Jul 29 04:38:24.220357 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: python threads support enabled Jul 29 04:38:24.220357 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: your server socket listen backlog is limited to 100 connections Jul 29 04:38:24.220357 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: your mercy for graceful operations on workers is 90 seconds Jul 29 04:38:24.220727 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 04:38:24.220802 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: *** Operational MODE: preforking *** Jul 29 04:38:24.221038 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: *** uWSGI is running in multiple interpreter mode *** Jul 29 04:38:24.221038 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: spawned uWSGI master process (pid: 115158) Jul 29 04:38:24.221227 dv-cinder-851449-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 04:38:24.222074 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: spawned uWSGI worker 1 (pid: 115159, cores: 1) Jul 29 04:38:24.222198 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: spawned uWSGI worker 2 (pid: 115160, cores: 1) Jul 29 04:38:24.222274 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 04:38:24.884496 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 04:38:24.885121 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 04:38:25.972512 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:38:25.972512 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: from cryptography.utils import int_from_bytes Jul 29 04:38:25.973172 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:38:25.973172 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: from cryptography.utils import int_from_bytes Jul 29 04:38:25.973799 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:38:25.973799 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: from cryptography.utils import int_from_bytes Jul 29 04:38:25.974236 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:38:25.974236 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: from cryptography.utils import int_from_bytes Jul 29 04:38:28.458874 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 04:38:28.459527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 04:38:28.459636 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 04:38:28.459989 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 04:38:28.460246 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 04:38:28.460652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.460984 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.461305 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.461628 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.461858 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 04:38:28.462242 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.462328 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 04:38:28.462406 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.462571 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.462669 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 04:38:28.462885 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.462971 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 04:38:28.463211 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.463298 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 04:38:28.463469 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.463604 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.463785 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.463933 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.464110 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-2-iscsi {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.464260 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.464430 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.464584 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.464763 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.464946 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.465073 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.465260 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.465389 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.465582 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.465676 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.465903 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.466000 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.466232 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.466319 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.466496 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.466787 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.466900 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.467131 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-2-iscsi {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.467252 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.467454 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.467574 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.467762 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.467907 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.468076 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.468188 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.468403 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.468538 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.468730 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.468865 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.469056 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.469184 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.469360 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.469493 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.469683 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.469865 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.470008 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.470177 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.470370 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-2-iscsi {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.470498 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.470685 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.470819 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.471034 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.471177 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.471310 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.471434 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.471699 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.471827 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.472007 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.472134 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.472347 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.472491 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.472706 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.472841 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.472978 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.473154 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.473379 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-2-iscsi {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.473507 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.473699 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.473827 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.474015 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.474155 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.474333 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.474473 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.474685 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.474813 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.474987 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.475114 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.475294 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.475430 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.475600 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.475738 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.475916 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.476043 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.476218 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.476358 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.476519 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.476665 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.476791 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.476930 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.477108 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.477244 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.477427 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.477563 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.477745 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.477884 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478065 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478196 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478318 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478449 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478573 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478705 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478841 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.478978 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.479153 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.479289 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.479459 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.479601 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.479765 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.479903 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.480068 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.480195 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.480374 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.480510 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.480704 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.480841 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.480975 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.481124 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.481330 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.481458 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.481582 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.481714 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.481848 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.481973 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.482129 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.482273 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.482441 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.482571 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.482822 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.482960 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.483100 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.483227 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.483356 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.483488 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.483648 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.483790 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.483957 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.484085 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.484267 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.484396 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.484591 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.484769 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.484922 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.485049 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.485237 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.485373 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.485543 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.485688 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.485846 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.485972 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.486149 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.486284 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.486452 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.486588 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.486770 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.486897 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.487097 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.487225 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.487398 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.487526 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.487659 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.487785 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.487920 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.488048 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.488800 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.488940 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.489178 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.489304 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.489492 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.489620 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.489804 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.489934 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.490126 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.490279 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.490463 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.490591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.490765 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.490893 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.491017 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.491147 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.491302 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.491429 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.491611 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.491796 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.491931 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.492064 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.492226 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.492363 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.492527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.492699 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.492935 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.493074 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.493211 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.493344 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.493469 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.493599 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.493731 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.493855 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.494040 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.494189 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.494345 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.494472 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.494650 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.494776 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.494950 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.495094 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.495263 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.495390 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.495565 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.495691 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.495868 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.496004 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.496183 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.496311 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.496487 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.496638 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.496814 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.496952 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.497123 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.497250 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.497432 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.497557 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.497735 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.497872 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.498046 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.498180 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.498343 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.498477 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.498645 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.498781 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.498959 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.499087 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.499262 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.499402 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.499563 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.499691 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.499862 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.499990 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.500162 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.500289 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.500461 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.500589 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.500787 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.500931 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.501086 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.501216 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.501386 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.501520 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.501681 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.501809 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.501995 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.502131 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.502304 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.502440 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.502602 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.502734 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.502905 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.503124 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.503252 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.503375 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.503499 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.503632 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.503792 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.504553 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.504744 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.504869 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.504992 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.505263 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.505411 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.505583 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.505712 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.505901 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.506027 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.506212 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.506340 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.506521 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.506657 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.506837 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.506963 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:38:28.507151 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.507288 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.507482 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.507616 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.507794 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.507921 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.508104 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.508240 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.508413 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.508541 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.508756 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.508897 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.509074 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.509278 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.509412 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.509543 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.509701 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.509830 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.510016 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.510144 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.510332 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.510480 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.510642 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.510771 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.510958 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.511098 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.511284 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.511412 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.511601 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.511736 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.511910 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.512046 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.512251 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.512390 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.512576 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.512749 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.512917 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.513045 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.513249 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.513375 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.513534 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.513661 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.513841 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.513977 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.514152 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.514279 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.514461 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.514588 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.514782 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.514911 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.515114 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.515243 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.515426 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.515553 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.515742 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.515871 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.516054 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.516190 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.516364 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.516499 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.516693 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.516822 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.517005 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.517133 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.517318 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.517459 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.517651 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.517788 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.517961 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.518087 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.518276 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.518412 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.518588 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.518722 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.518898 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.519031 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.519211 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.519347 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.519551 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.519686 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.519869 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.520059 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.520196 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.520367 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.520494 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.520699 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.520859 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.521007 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.521181 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.521311 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.521502 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.521629 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.521819 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.521946 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.522230 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.522357 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.522535 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.522663 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.522867 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.523001 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.523172 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.523375 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.523504 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.523627 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.523777 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.523921 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.524081 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.524213 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.524385 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.524513 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.524722 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.524866 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.525035 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.525163 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.525342 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.525471 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.525661 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.525796 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.525969 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.526095 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.526274 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.526401 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.526585 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.526721 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.526887 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.527013 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.527191 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.527326 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.527501 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.527629 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.527808 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.527933 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.528119 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.528246 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.528429 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.528563 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.528760 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.528900 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.529081 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.529208 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.529387 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.529521 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.529694 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.529822 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.530012 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.530140 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.530326 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.530461 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.530630 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.530758 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.530930 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.531064 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.531241 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.531369 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.531563 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.531688 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.531868 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.532077 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.532205 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.532327 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.532461 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.532585 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.532783 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.532926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.533089 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.533216 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.533422 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.533551 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.533700 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.533839 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.534005 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.534141 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.534309 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.534437 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.534613 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.534742 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.534918 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.535046 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.535289 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.535416 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.535600 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.535728 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.535913 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.536044 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.536219 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.536348 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.536528 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.536688 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.536861 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.536989 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.537168 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.537295 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.537475 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.537605 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.537799 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.537929 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.538110 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.538247 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.538423 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.538558 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.538710 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.538837 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.539017 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.539159 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.539345 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.539470 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.539657 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.539792 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.539967 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.540102 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.540279 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.540406 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.540628 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.540759 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.540930 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.541070 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.541249 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.541378 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.541558 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.541685 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.541869 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.542006 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.542177 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.542305 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.542488 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.542622 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.542790 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.542917 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.543104 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.543232 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.543416 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.543627 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.543758 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.543883 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.544036 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.544413 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.544645 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.544776 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.544955 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.545085 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.545281 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.545408 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.545589 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.545718 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.545908 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.546043 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.546216 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.546354 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.546530 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.546667 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.546850 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.546977 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.547162 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.547296 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.547482 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.547632 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.547793 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.547932 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.548093 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.548215 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.548405 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.548533 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.548742 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.548872 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.549058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.549187 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.549396 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.549534 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.549682 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.549815 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.550006 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.550134 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.550314 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.550454 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.550628 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.551261 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.551482 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.551650 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.551789 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.551974 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.552105 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.552284 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.552419 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.552651 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.552803 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.552961 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.553096 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.553298 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.553427 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.553666 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.553811 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.553946 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.554070 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.554193 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.554316 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.554501 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.554637 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.554815 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.554944 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.555124 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.555251 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.555428 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.555556 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.555734 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.555860 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.556042 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.556167 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.556362 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.556488 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.556693 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.556822 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.557009 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.557136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.557321 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.557452 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.557620 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.557754 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558000 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558136 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558270 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558401 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558525 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558656 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558828 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.558979 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.559129 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.559255 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.559430 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.559557 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.559763 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.559898 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.560067 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.560194 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.560366 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.560493 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.560691 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.560833 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.561018 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.561145 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.561332 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.561466 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.561640 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.561848 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.561975 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.562087 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.562240 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.562367 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.562558 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.562693 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.562872 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.562999 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.563179 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.563299 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.563490 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.563628 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.563832 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.563967 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.564091 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.564213 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.564407 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.564544 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.564720 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.564844 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.565041 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.565168 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.565349 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.565485 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.565660 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.565789 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.565963 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.566100 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.566274 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.566981 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.567141 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.567271 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.567597 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.567833 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.567961 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.568167 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.568293 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.568487 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.568643 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.568841 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.568977 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.569164 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.569292 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.569471 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.569598 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.569788 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.569916 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.570109 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.570237 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.570444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.570671 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.570809 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.571008 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.571137 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.571325 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.571453 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.571639 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.571772 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.571951 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.572079 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.572259 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.572386 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.572565 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.572750 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.572885 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.573009 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.573193 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.573320 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.573500 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.573636 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.573808 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.574016 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.574145 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.574269 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.574392 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.574516 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.574713 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.574844 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.575020 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.575147 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.575333 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.575459 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.575638 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.575765 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.575949 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.576075 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.576261 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.576388 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.576565 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.576776 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.576906 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.577038 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.577187 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.577324 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.577503 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.577630 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.577812 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.577950 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.578130 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.578272 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.578440 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.578569 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.578767 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.578902 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.579081 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.579217 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.579384 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.579510 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.579690 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.579823 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.579999 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.580137 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.580303 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.580429 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.580628 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.580770 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.580940 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.581082 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.581250 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.581379 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.581555 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.581685 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.581868 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.582017 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.582231 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.582444 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.582573 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.582840 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.582976 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.583182 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.583309 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.583498 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.583684 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.583797 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.584083 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.584223 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.584348 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.584471 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.584659 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.584805 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.584970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.585098 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.585275 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.585403 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.585586 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.585721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.585896 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.586022 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.586200 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.586327 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.586513 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.586722 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.586849 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.586972 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.587103 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.587228 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.587409 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.587545 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.587718 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.587844 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.588021 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.588148 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.588331 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.588460 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.588663 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.588792 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.588969 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.589094 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.589281 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.589408 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.589590 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.589717 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.589891 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.590016 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.590194 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.590321 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.590500 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.590626 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.590802 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.590925 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.591105 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.591232 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.591414 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.591547 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.591722 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.591858 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.592034 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.592168 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.592337 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.592462 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.592675 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.592865 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.593002 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.593128 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.593283 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.593412 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.593589 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.593732 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.593896 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.594025 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.594232 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.594360 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.594521 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.594659 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.594825 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.594952 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.595129 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.595258 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.595431 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.595560 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.595736 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.595863 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.596046 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.596173 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.596350 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.596478 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.596714 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.596845 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.597023 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.597151 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.597347 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.597482 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.597683 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.597812 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.598067 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.598318 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.598467 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.598594 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.598718 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.598841 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.598974 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.599108 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.599285 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.599419 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.599600 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.599728 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.599917 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.600055 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.600224 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.600352 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.600540 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.600706 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.600883 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.601027 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.601199 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.601327 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.601504 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.601632 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.601807 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.601949 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.602128 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.602256 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.602441 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.602568 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.602754 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.602883 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.603075 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.603203 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.603395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.603529 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.603714 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.603843 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.604018 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.604143 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.604354 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.604492 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.604655 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.604782 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.604944 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.605084 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.605256 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.605383 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.605567 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.605696 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.605879 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.606007 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.606191 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.606321 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.606505 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.606634 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.606812 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.606938 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.607128 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.607265 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.607446 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.607574 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.607759 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.607894 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.608068 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.608204 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.608374 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.608510 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.608721 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.608851 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.609034 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.609172 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.609339 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.609467 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.609647 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.609775 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.609953 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.610095 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.610265 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.610393 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.610568 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.610703 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.610901 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.611029 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.611213 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.611341 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.611545 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.611674 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.611861 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.611990 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.612172 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.612308 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.612483 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.612623 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.612817 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.612945 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.613129 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.613815 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.614109 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.614249 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.614398 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.614595 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.614724 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.614856 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.614982 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.615118 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.615281 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.615410 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.615587 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.615716 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.615892 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.616102 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.616230 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.616354 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.616514 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.616711 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.616841 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.617030 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.617168 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.617429 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.617556 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.617753 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.617890 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.618066 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.618194 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.618382 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.618509 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.618693 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.618829 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.619003 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.619132 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.619322 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.619450 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.619650 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.619787 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.619959 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.620087 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.620267 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.620395 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.620575 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.620758 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.620922 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.621051 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.621232 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.621359 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.621558 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.621695 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.621928 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.622055 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.622240 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.622368 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.622565 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.622706 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.622890 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.623017 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.623204 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.623358 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.623521 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.623652 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.623827 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.623958 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.624153 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.624289 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.624477 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.624636 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.624845 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.624981 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.625147 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.625277 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.625463 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.625592 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.625797 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.625937 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.626132 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.626262 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.626451 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.626587 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.626792 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.626920 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.627073 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.627202 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.627393 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.627529 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.627706 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.627835 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.628019 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.628154 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.628324 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.628461 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.628667 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.628799 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.629567 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.629705 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.629939 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.630177 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.630305 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.630431 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.630564 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.630698 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.630838 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.630977 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.631111 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.631236 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.631368 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.631495 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.631673 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.631803 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.631993 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.632121 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.632308 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.632443 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.632654 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.632786 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.632980 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.633110 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.633285 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.633415 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.633598 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.633726 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.633904 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.634022 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.634208 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.634345 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.634512 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.634634 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.634886 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.635025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.635150 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.635282 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.635444 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.635572 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.635760 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.635886 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.636089 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.636230 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.636397 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.636524 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.636738 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.636867 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.637051 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.637187 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.637362 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.637490 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.637671 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.637807 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.637983 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.638121 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.638304 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.638431 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.638591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.638723 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.638898 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.639027 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.639206 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.639334 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.639510 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.639638 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.639812 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.639942 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.640113 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.640241 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.640421 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.640548 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.640748 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.640879 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.641053 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.641187 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.641354 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.641491 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.641675 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.641802 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.641976 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.642105 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.642296 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.642437 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.642603 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.642731 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.642905 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.643041 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.643208 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.643348 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.643509 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.643637 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.643827 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.643953 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.644135 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.644273 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.644467 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.644738 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.644974 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.645226 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.645370 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.645496 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.645620 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.645750 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.645874 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.645996 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.646129 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.646254 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.646385 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.646509 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.646665 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.646801 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.646981 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.647109 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.647296 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.647423 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.647611 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.647734 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.648042 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.648173 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.648289 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.648417 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.648556 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.648694 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.648897 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.649013 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.649213 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.649327 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.649530 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.649659 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.649853 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.650061 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.650183 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.650391 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.650515 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.650707 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.650823 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.651019 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.651132 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.651332 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.651447 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.651648 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.651763 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.651961 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.652074 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.652837 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.652984 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653110 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653237 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653360 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653485 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653618 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653743 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653866 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.653988 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.654110 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.654223 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.654353 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.654478 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.654615 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.654739 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.654852 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.655010 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.655152 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.655369 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.655499 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.655625 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.655749 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.655950 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.656079 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.656240 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.656370 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.656576 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.656725 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.656921 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.657053 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.657237 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.657364 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.657552 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.657691 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.657866 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.657994 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.658167 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.658293 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.658478 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.658625 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.658789 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.658925 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.659102 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.659233 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.659412 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.659541 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.659722 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.659859 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.660034 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.660186 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.660419 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.660591 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.660786 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.661068 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.661182 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.661395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.661518 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.661706 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.661819 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.662021 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.662133 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.662337 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.662598 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.662720 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.662862 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.662977 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.663199 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.663322 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.663527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.663649 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.663853 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.663968 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.664169 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.664293 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.664488 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.664623 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.664838 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.664957 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.665144 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.665289 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.665498 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.665626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.665750 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.665981 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.666124 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.666303 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.666431 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.666642 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.666770 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.666951 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.667088 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.667258 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.667386 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.667578 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.667706 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.667890 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.668027 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.668218 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.668424 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.668552 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.668801 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.668937 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.669121 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.669512 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.669711 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.669839 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.670015 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.670155 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.670342 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.670471 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.670657 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.670786 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.670968 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.671105 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.671293 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.671423 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.671608 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.671736 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.671926 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.672143 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.672272 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.672492 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.672663 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.672837 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.672966 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.673145 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.673272 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.673456 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.673584 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.673763 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.673901 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.674075 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.674211 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.674381 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.674510 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.674694 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.674830 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.675002 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.675128 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.675308 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.675436 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.675642 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.676294 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.676449 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.676579 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.676783 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.676913 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.677157 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.677301 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.677530 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.677658 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.677844 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.678031 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.678172 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.678457 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.678584 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.678790 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.678943 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.679099 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.679408 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.679543 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.679716 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.679844 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.680032 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.680305 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.680442 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.680654 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.680798 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.680966 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.681264 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.681392 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.681577 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.681781 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.681911 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.682185 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.682312 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.682493 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.682676 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.682805 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.683099 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.683226 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.683411 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.683624 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.683752 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.684079 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.684209 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.684387 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.684515 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.684717 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.685008 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.685147 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.685339 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.685473 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.685689 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.685944 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.686073 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.686276 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.686411 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.686633 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.686956 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.687133 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.687482 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.687610 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.687815 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.687943 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.688134 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.688259 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.688455 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.688584 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.688818 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.688947 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.689131 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.689259 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.689437 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.689564 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.689746 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.689883 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.690069 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.690198 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.690378 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.690505 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.690690 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.690830 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.690997 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.691124 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.691386 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.692012 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.692212 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.692401 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.692531 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.692764 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.692894 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.693083 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.693211 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.693402 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.693531 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.693717 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.693852 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.694031 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.694169 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.694347 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.694476 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.694661 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.694789 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.694973 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.695108 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.695284 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.695404 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.695603 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.695754 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.695946 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.696090 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.696217 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.696341 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.696538 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.696722 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.696861 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.696989 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.697169 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.697298 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.697479 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.697608 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.697788 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.697917 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.698103 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.698241 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.698411 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.698540 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.698732 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.698870 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.699034 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.699161 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.699367 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.699508 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.699676 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.699805 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.700063 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.700190 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.700385 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.700523 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.700720 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.700862 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.701044 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.701173 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.701355 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.701491 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.701666 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.701793 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.701989 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.702124 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.702301 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.702438 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.702623 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.702758 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.702938 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.703066 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.703272 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.703402 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.703594 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.703721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.703901 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.704029 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.704207 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.704336 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.704512 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.704661 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.704845 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.704991 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.705155 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.705282 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.705463 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.705590 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.705766 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.705905 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.706125 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.706257 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.706382 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.706505 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.706658 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.706796 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.707004 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.707196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.707326 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.707467 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.707658 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.707801 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.707928 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.708064 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.708190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.708314 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.708453 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.708580 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.708785 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.708958 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.709094 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.709235 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.709375 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.709501 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.709691 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.709820 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.709999 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.710137 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.710302 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.710431 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.710607 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.710744 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.710911 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.711039 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.711214 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.711357 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.711517 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.711645 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.711843 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.711980 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.712157 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.712287 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.712476 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.712634 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.712826 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.712969 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.713139 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.713268 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.713460 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.713587 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.713770 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.713907 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.714090 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.714218 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.714409 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.714538 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.714723 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.714864 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.715033 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.715176 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.715364 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.715485 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.715675 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.715803 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.715985 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.716125 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.716319 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.716449 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.716583 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.716804 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.716930 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.717054 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.717211 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.717339 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.717545 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.717681 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.717841 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.717979 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.718144 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.718281 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.718469 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.718606 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.718784 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.718912 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.719102 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.719238 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.719418 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.719547 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.719728 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.719856 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.720047 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.720187 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.720356 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.720482 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.720689 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.720820 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.721000 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.721136 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.721310 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.721439 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.721621 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.721749 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.721933 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.722060 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.722239 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.722377 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.722549 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.722710 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.722924 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.723101 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.723274 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.723430 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.723564 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.723699 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.723861 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.723990 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.724171 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.724300 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.724497 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.724670 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.724848 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.724978 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.725183 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.725309 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.725492 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.725626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.725837 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.725966 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.726158 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.726299 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.726492 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.726633 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.726760 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.726886 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.727056 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.727184 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.727322 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 04:38:28.727449 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.727734 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:38:28.727982 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115159) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 04:38:28.882489 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO dbcounter [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Registered counter for database nova_api Jul 29 04:38:28.882699 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO dbcounter [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Registered counter for database nova_api Jul 29 04:38:28.902287 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:28.903877 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_db.sqlalchemy.engines [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:28.908861 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writer thread running {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:28.910916 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writer thread running {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:28.965068 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.context [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4aee4dd5-d750-4ce7-b7ef-1adbdadced01(cell1) {{(pid=115160) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 04:38:28.967018 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.context [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4aee4dd5-d750-4ce7-b7ef-1adbdadced01(cell1) {{(pid=115159) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 04:38:28.969107 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:38:28.970687 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:38:28.970970 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_concurrency.lockutils [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:38:28.971484 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:38:28.972643 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_concurrency.lockutils [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:38:28.973466 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_concurrency.lockutils [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:38:28.973621 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:38:28.975445 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_concurrency.lockutils [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115159) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:38:28.975781 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO dbcounter [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Registered counter for database nova_cell0 Jul 29 04:38:28.977435 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO dbcounter [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Registered counter for database nova_cell0 Jul 29 04:38:28.981183 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO dbcounter [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Registered counter for database nova_cell1 Jul 29 04:38:28.982824 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO dbcounter [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Registered counter for database nova_cell1 Jul 29 04:38:28.988507 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:28.991294 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:28.992290 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_db.sqlalchemy.engines [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:28.994701 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writer thread running {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:28.995451 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_db.sqlalchemy.engines [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:28.998356 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writer thread running {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:29.131368 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writer thread running {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:29.136842 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writer thread running {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:29.141140 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO dbcounter [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Registered counter for database nova_cell0 Jul 29 04:38:29.146423 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO dbcounter [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Registered counter for database nova_cell0 Jul 29 04:38:29.150749 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_db.sqlalchemy.engines [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:29.155017 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG oslo_db.sqlalchemy.engines [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115159) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:38:29.155713 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writer thread running {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:29.159613 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writer thread running {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:38:29.497996 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: WARNING keystonemiddleware.auth_token [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:38:29.498568 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: WARNING keystonemiddleware.auth_token [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:38:29.505920 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: WARNING keystonemiddleware.auth_token [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:38:29.506523 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: WARNING keystonemiddleware.auth_token [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:38:29.849890 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: WARNING keystonemiddleware.auth_token [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:38:29.855796 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: WARNING keystonemiddleware.auth_token [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:38:29.856016 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: WARNING keystonemiddleware.auth_token [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:38:29.861135 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556c8e6dd9c0 pid: 115160 (default app) Jul 29 04:38:29.861999 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: WARNING keystonemiddleware.auth_token [None req-74f14955-7b48-4fac-81ce-d6ba4d8c4dff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:38:29.863815 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:38:29.865022 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002351 Jul 29 04:38:29.865430 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Fri Jul 29 04:38:29 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:38:29.868062 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556c8e6dd9c0 pid: 115159 (default app) Jul 29 04:39:45.880588 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:39:45.881633 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 29 04:39:45.882188 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:39:45.898572 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writing DB stats nova_api:SELECT=3 {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:45.899502 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writing DB stats nova_cell0:SELECT=3 {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:45.900321 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writing DB stats nova_cell1:SELECT=3 {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:45.901165 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:46.767452 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-e6a1ebc4-aacf-4ea6-8802-79c893f26bc5 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:39:46.801905 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-e6a1ebc4-aacf-4ea6-8802-79c893f26bc5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913068 Jul 29 04:39:46.802834 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 29 04:39:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:39:49.018182 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:39:49.019190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-e27dec40-1734-425c-8a98-13e5da74839f None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 29 04:39:49.019595 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:39:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:39:49.468436 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-3ea135ce-08d5-4fed-bb09-6f01f6008f91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:49.488660 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:49.488660 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: warnings.warn(msg) Jul 29 04:39:49.518003 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-3ea135ce-08d5-4fed-bb09-6f01f6008f91 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492229 Jul 29 04:39:49.518750 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:39:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:39:49.532988 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_api:SELECT=3 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:49.534213 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_cell1:SELECT=3 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:49.535243 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_cell0:SELECT=3 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:49.536033 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:39:49.742368 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-338e1403-adeb-4395-aa03-a92b73b24f4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:49.746724 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:49.746724 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: warnings.warn(msg) Jul 29 04:39:49.814783 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-338e1403-adeb-4395-aa03-a92b73b24f4c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287822 Jul 29 04:39:49.820752 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 29 04:39:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:39:52.060939 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-3ea135ce-08d5-4fed-bb09-6f01f6008f91 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:39:52.062918 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-3ea135ce-08d5-4fed-bb09-6f01f6008f91 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002286 Jul 29 04:39:52.063583 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:39:52.717744 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-46e4c6c6-b250-4d64-8c65-6773bc62dda7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "ram": 512, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:52.737997 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:52.737997 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: warnings.warn(msg) Jul 29 04:39:52.758992 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-46e4c6c6-b250-4d64-8c65-6773bc62dda7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689279 Jul 29 04:39:52.759648 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:39:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:39:52.772140 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-7d02c0c1-e255-4e0b-8c1b-18e9460d0aaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:52.774976 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:39:52.774976 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: warnings.warn(msg) Jul 29 04:39:52.810101 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-7d02c0c1-e255-4e0b-8c1b-18e9460d0aaf admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041999 Jul 29 04:39:52.810865 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 29 04:39:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:39:55.036545 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-46e4c6c6-b250-4d64-8c65-6773bc62dda7 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:39:55.037612 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-46e4c6c6-b250-4d64-8c65-6773bc62dda7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 29 04:39:55.052023 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:39:55.454611 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-837a6789-4f33-4511-b3b5-2166e285f960 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:55.473671 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-837a6789-4f33-4511-b3b5-2166e285f960 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428204 Jul 29 04:39:55.474318 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:39:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:39:55.486343 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-0ab26d65-0e98-4c5a-8369-17e3089ab01f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:55.509879 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-0ab26d65-0e98-4c5a-8369-17e3089ab01f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027439 Jul 29 04:39:55.510449 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 29 04:39:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:39:57.709556 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-837a6789-4f33-4511-b3b5-2166e285f960 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:39:57.711290 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-837a6789-4f33-4511-b3b5-2166e285f960 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 29 04:39:57.711290 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:39:58.129228 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-2541805c-38ed-4dad-b218-048ee9f1d3da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "swap": 0, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:58.149675 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-2541805c-38ed-4dad-b218-048ee9f1d3da admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432290 Jul 29 04:39:58.150318 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:39:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:39:58.162779 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-5b1dd988-189f-4ac2-abd3-8af2392076ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:39:58.188068 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-5b1dd988-189f-4ac2-abd3-8af2392076ce admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028822 Jul 29 04:39:58.188660 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 29 04:39:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:40:00.435329 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-2541805c-38ed-4dad-b218-048ee9f1d3da admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:00.436369 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-2541805c-38ed-4dad-b218-048ee9f1d3da admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 29 04:40:00.438817 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:00.934115 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-df710f80-55cf-4694-97a2-35fdef104a6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:00.964177 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-df710f80-55cf-4694-97a2-35fdef104a6e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520388 Jul 29 04:40:00.965258 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:40:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:00.982551 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-e92eb6c8-97fc-49a4-bda5-7b6c91705b4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:01.013594 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-e92eb6c8-97fc-49a4-bda5-7b6c91705b4d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034520 Jul 29 04:40:01.014704 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Fri Jul 29 04:40:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:40:03.473984 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-df710f80-55cf-4694-97a2-35fdef104a6e admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:03.475000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-df710f80-55cf-4694-97a2-35fdef104a6e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 29 04:40:03.475397 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:03.917091 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-f5553834-5665-4455-b299-91ad88658d0d admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:03.943300 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-f5553834-5665-4455-b299-91ad88658d0d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460631 Jul 29 04:40:03.943848 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 29 04:40:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:40:06.300887 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-df710f80-55cf-4694-97a2-35fdef104a6e admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:06.301872 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-df710f80-55cf-4694-97a2-35fdef104a6e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 29 04:40:06.302275 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:06.775952 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-f03ecdc3-b3fd-4a95-ab89-449e1ae31657 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:06.804758 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-f03ecdc3-b3fd-4a95-ab89-449e1ae31657 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.492850 Jul 29 04:40:06.805768 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:40:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:06.818187 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-3786b361-763e-414c-a388-137654ae7942 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:06.845586 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-3786b361-763e-414c-a388-137654ae7942 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031370 Jul 29 04:40:06.846172 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 29 04:40:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:40:09.221846 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-f03ecdc3-b3fd-4a95-ab89-449e1ae31657 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:09.222867 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-f03ecdc3-b3fd-4a95-ab89-449e1ae31657 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 29 04:40:09.223432 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:09.648615 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-8316f0eb-181d-454d-87e2-e68de1fcd508 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2"}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:09.668945 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-8316f0eb-181d-454d-87e2-e68de1fcd508 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439410 Jul 29 04:40:09.669438 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:40:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 04:40:09.682527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-e81beccd-cb96-475c-b1a8-fa0434aac914 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:09.706901 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-e81beccd-cb96-475c-b1a8-fa0434aac914 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028116 Jul 29 04:40:09.707458 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 29 04:40:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:40:11.998256 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-8316f0eb-181d-454d-87e2-e68de1fcd508 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:12.000019 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-8316f0eb-181d-454d-87e2-e68de1fcd508 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 29 04:40:12.000436 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:12.413420 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-3495db81-20f6-4d24-8224-1158c78f4072 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:12.433472 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-3495db81-20f6-4d24-8224-1158c78f4072 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.426639 Jul 29 04:40:12.434573 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:40:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:12.447046 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-a1def4b4-76e3-4225-8855-d21e7c10552c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:12.476571 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-a1def4b4-76e3-4225-8855-d21e7c10552c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033406 Jul 29 04:40:12.477234 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 29 04:40:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:40:14.846283 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-3495db81-20f6-4d24-8224-1158c78f4072 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:14.847200 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-3495db81-20f6-4d24-8224-1158c78f4072 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 29 04:40:14.847599 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:15.387074 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-24a2aca0-a5e3-4cc9-957b-184c8c2206d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:15.408351 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-24a2aca0-a5e3-4cc9-957b-184c8c2206d2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.554450 Jul 29 04:40:15.408935 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:40:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:15.422710 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-5febbda9-b5d9-4531-9f3f-fda206fe38ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:15.451012 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-5febbda9-b5d9-4531-9f3f-fda206fe38ad admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033647 Jul 29 04:40:15.451727 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 29 04:40:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:40:17.815895 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-24a2aca0-a5e3-4cc9-957b-184c8c2206d2 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:17.816982 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-24a2aca0-a5e3-4cc9-957b-184c8c2206d2 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 29 04:40:17.817896 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:18.258493 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-69584145-821f-4072-bfde-cfc6f1daee70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:18.278640 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-69584145-821f-4072-bfde-cfc6f1daee70 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455439 Jul 29 04:40:18.279507 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Fri Jul 29 04:40:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 04:40:18.291422 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-0f11d04d-f5b3-437f-816c-024ad080e160 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:18.297470 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:40:18.320139 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-0f11d04d-f5b3-437f-816c-024ad080e160 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032355 Jul 29 04:40:18.320667 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Fri Jul 29 04:40:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:40:38.417589 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-69584145-821f-4072-bfde-cfc6f1daee70 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:38.418589 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-69584145-821f-4072-bfde-cfc6f1daee70 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 29 04:40:38.419232 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:38.819029 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-5e7b02a1-466a-4519-82f8-5a8fd2f2c970 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:38.837412 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-5e7b02a1-466a-4519-82f8-5a8fd2f2c970 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.412246 Jul 29 04:40:38.837870 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 29 04:40:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:40:39.902452 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-69584145-821f-4072-bfde-cfc6f1daee70 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:39.903462 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-69584145-821f-4072-bfde-cfc6f1daee70 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 29 04:40:39.903913 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:40.423993 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-bc1940ac-c7c4-4151-a0c0-08e120676b2c admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:40.429603 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.wsgi [None req-bc1940ac-c7c4-4151-a0c0-08e120676b2c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-bc1940ac-c7c4-4151-a0c0-08e120676b2c admin admin] Request method failure captured: Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Accept: application/json Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Accept-Encoding: gzip, deflate Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Connection: keep-alive Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Content-Length: 0 Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Host: 10.222.0.40 Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Openstack-Api-Version: compute 2.90 Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Openstack-System-Scope: None Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: User-Agent: python-novaclient Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Auth-Token: gAAAAABi42TH0tEE1qPfSp8JN6zLuEVbcArCYiGDysegIbopgN2TlXeamLrlVQFmp3LODWgvAjK0OBG8KN0pIvLhAwmnuSJ-SyyO9vEZKsVXvKg7Wyt0jDSHuwGD1k4IGFDNxCIssvnavfely2fbbmf3oFdifryQwe6g-21huc5DBeaAouUOGFE Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Domain-Id: None Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Domain-Name: None Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Identity-Status: Confirmed Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Is-Admin-Project: True Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Domain-Id: default Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Domain-Name: Default Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Name: admin Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Role: admin,reader,member Jul 29 04:40:40.432923 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Roles: admin,reader,member Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant: admin Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant-Name: admin Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User: admin Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Domain-Id: default Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Domain-Name: Default Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Id: cfc9fe47ed4740a0aaddec545dbaca1a Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Name: admin Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: method: > Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: exception: Flavor 42 could not be found. Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: action_args: {'id': '42'} Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:40:40.434626 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:40.435666 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.436898 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-bc1940ac-c7c4-4151-a0c0-08e120676b2c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:40:40.438327 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-bc1940ac-c7c4-4151-a0c0-08e120676b2c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393389 Jul 29 04:40:40.438327 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 29 04:40:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 04:40:40.444126 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-832cc5d7-5efc-47ec-a641-e506c2382d1f admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:40.448325 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:40:40.468942 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-832cc5d7-5efc-47ec-a641-e506c2382d1f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028217 Jul 29 04:40:40.469528 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 29 04:40:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:40:40.479221 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-2b03dc35-74b0-44d8-a45f-c85d46976315 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:40.502628 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-2b03dc35-74b0-44d8-a45f-c85d46976315 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026977 Jul 29 04:40:40.503178 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 29 04:40:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:40:40.512987 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-494e688f-2281-41c9-a810-c2b4c1379296 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:40.519774 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.wsgi [None req-494e688f-2281-41c9-a810-c2b4c1379296 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-494e688f-2281-41c9-a810-c2b4c1379296 admin admin] Request method failure captured: Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Accept: application/json Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Accept-Encoding: gzip, deflate Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Connection: keep-alive Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Content-Length: 0 Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Host: 10.222.0.40 Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Openstack-Api-Version: compute 2.90 Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Openstack-System-Scope: None Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: User-Agent: python-novaclient Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Auth-Token: gAAAAABi42TH0tEE1qPfSp8JN6zLuEVbcArCYiGDysegIbopgN2TlXeamLrlVQFmp3LODWgvAjK0OBG8KN0pIvLhAwmnuSJ-SyyO9vEZKsVXvKg7Wyt0jDSHuwGD1k4IGFDNxCIssvnavfely2fbbmf3oFdifryQwe6g-21huc5DBeaAouUOGFE Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Domain-Id: None Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Domain-Name: None Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Identity-Status: Confirmed Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Is-Admin-Project: True Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Domain-Id: default Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Domain-Name: Default Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Name: admin Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Role: admin,reader,member Jul 29 04:40:40.523591 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Roles: admin,reader,member Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant: admin Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant-Name: admin Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User: admin Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Domain-Id: default Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Domain-Name: Default Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Id: cfc9fe47ed4740a0aaddec545dbaca1a Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Name: admin Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: method: > Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: exception: Flavor 42 could not be found. Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: action_args: {'id': '42'} Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:40:40.525196 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:40.526070 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:40.527136 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-494e688f-2281-41c9-a810-c2b4c1379296 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:40:40.528162 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-494e688f-2281-41c9-a810-c2b4c1379296 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016100 Jul 29 04:40:40.528162 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 29 04:40:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 04:40:41.502670 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-2b03dc35-74b0-44d8-a45f-c85d46976315 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:41.503685 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-2b03dc35-74b0-44d8-a45f-c85d46976315 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 29 04:40:41.504076 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:42.036813 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-a3df905a-5efe-4607-9fba-8a41f8575dc9 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:42.042163 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.wsgi [None req-a3df905a-5efe-4607-9fba-8a41f8575dc9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-a3df905a-5efe-4607-9fba-8a41f8575dc9 admin admin] Request method failure captured: Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Accept: application/json Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Accept-Encoding: gzip, deflate Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Connection: keep-alive Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Content-Length: 0 Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Host: 10.222.0.40 Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Openstack-Api-Version: compute 2.90 Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Openstack-System-Scope: None Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: User-Agent: python-novaclient Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Auth-Token: gAAAAABi42TJTcaOEyULHUS5QvKEU7HtrCDWDyf8upbTftANrH29MdCmC2iyq8bqbGyTQG4XVrwBijfbTa0ccmrXfrDdJQPh8YFPCgVAGUHEDhHSoalfx9sP82euewbQoJ2jJ-biiqY7aPajg6nSSWwcg_XpUaSmRI_TgT3bWq9k524MBw2t26U Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Domain-Id: None Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Domain-Name: None Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Identity-Status: Confirmed Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Is-Admin-Project: True Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Domain-Id: default Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Domain-Name: Default Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Name: admin Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Role: admin,reader,member Jul 29 04:40:42.043652 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Roles: admin,reader,member Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant: admin Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant-Name: admin Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User: admin Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Domain-Id: default Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Domain-Name: Default Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Id: cfc9fe47ed4740a0aaddec545dbaca1a Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Name: admin Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: method: > Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: exception: Flavor 84 could not be found. Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: action_args: {'id': '84'} Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:40:42.045444 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:42.046527 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.047888 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-a3df905a-5efe-4607-9fba-8a41f8575dc9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:40:42.049183 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-a3df905a-5efe-4607-9fba-8a41f8575dc9 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398149 Jul 29 04:40:42.049183 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 29 04:40:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 04:40:42.055000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-969ae9e9-0877-46c3-a158-879b801c7fd3 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:42.069980 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-969ae9e9-0877-46c3-a158-879b801c7fd3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018538 Jul 29 04:40:42.070505 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 29 04:40:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:40:42.080133 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-348f57f9-e931-4214-ac4e-cd7553554346 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:42.095280 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-348f57f9-e931-4214-ac4e-cd7553554346 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019128 Jul 29 04:40:42.095792 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 29 04:40:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:40:42.104900 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-7f4965d9-a046-4522-a733-87b97e16cff3 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:42.110891 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.wsgi [None req-7f4965d9-a046-4522-a733-87b97e16cff3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-7f4965d9-a046-4522-a733-87b97e16cff3 admin admin] Request method failure captured: Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Accept: application/json Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Accept-Encoding: gzip, deflate Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Connection: keep-alive Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Content-Length: 0 Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Host: 10.222.0.40 Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Openstack-Api-Version: compute 2.90 Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Openstack-System-Scope: None Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: User-Agent: python-novaclient Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Auth-Token: gAAAAABi42TJTcaOEyULHUS5QvKEU7HtrCDWDyf8upbTftANrH29MdCmC2iyq8bqbGyTQG4XVrwBijfbTa0ccmrXfrDdJQPh8YFPCgVAGUHEDhHSoalfx9sP82euewbQoJ2jJ-biiqY7aPajg6nSSWwcg_XpUaSmRI_TgT3bWq9k524MBw2t26U Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Domain-Id: None Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Domain-Name: None Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Identity-Status: Confirmed Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Is-Admin-Project: True Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Domain-Id: default Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Domain-Name: Default Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Name: admin Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Role: admin,reader,member Jul 29 04:40:42.112395 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Roles: admin,reader,member Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant: admin Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant-Name: admin Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User: admin Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Domain-Id: default Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Domain-Name: Default Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Id: cfc9fe47ed4740a0aaddec545dbaca1a Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Name: admin Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: method: > Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: exception: Flavor 84 could not be found. Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: action_args: {'id': '84'} Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:40:42.113948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:42.114926 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:42.116000 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-7f4965d9-a046-4522-a733-87b97e16cff3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:40:42.117207 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-7f4965d9-a046-4522-a733-87b97e16cff3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012353 Jul 29 04:40:42.117207 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Jul 29 04:40:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 04:40:43.073645 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-348f57f9-e931-4214-ac4e-cd7553554346 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:43.074645 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-348f57f9-e931-4214-ac4e-cd7553554346 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 29 04:40:43.075039 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:43.607087 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-4a06551d-56ea-4a73-b97b-0cc644647ca2 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:43.613507 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.wsgi [None req-4a06551d-56ea-4a73-b97b-0cc644647ca2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-4a06551d-56ea-4a73-b97b-0cc644647ca2 admin admin] Request method failure captured: Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Accept: application/json Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Accept-Encoding: gzip, deflate Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Connection: keep-alive Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Content-Length: 0 Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Host: 10.222.0.40 Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Openstack-Api-Version: compute 2.90 Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Openstack-System-Scope: None Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: User-Agent: python-novaclient Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Auth-Token: gAAAAABi42TKbiuN5A0vSRpvclNM1w2Rnpc30YxElGGE7sTM4xPulaQTvcxTnBC7KwGLmD6xvC980wXkaQ_Dka15htrXXvWSXIMCv462d3Q4SpIcXnGHvg28SeTkjOT10xkeh1-oICGLx-VUBDBvXdGqz4ekGSqmQ7J9540nePU2plinbd0fC4A Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Domain-Id: None Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Domain-Name: None Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Identity-Status: Confirmed Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Is-Admin-Project: True Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Domain-Id: default Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Domain-Name: Default Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Project-Name: admin Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Role: admin,reader,member Jul 29 04:40:43.615025 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Roles: admin,reader,member Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant: admin Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-Tenant-Name: admin Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User: admin Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Domain-Id: default Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Domain-Name: Default Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Id: cfc9fe47ed4740a0aaddec545dbaca1a Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: X-User-Name: admin Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: method: > Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: exception: Flavor 451 could not be found. Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: action_args: {'id': '451'} Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:40:43.616684 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:43.617721 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.619058 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-4a06551d-56ea-4a73-b97b-0cc644647ca2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115159) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:40:43.620287 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-4a06551d-56ea-4a73-b97b-0cc644647ca2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.401056 Jul 29 04:40:43.620287 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 29 04:40:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 04:40:43.627109 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-86e7a39a-89ff-4537-aa78-3cd11ce48c88 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:43.642248 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-86e7a39a-89ff-4537-aa78-3cd11ce48c88 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019723 Jul 29 04:40:43.642776 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 29 04:40:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:40:43.652084 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:43.667181 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018631 Jul 29 04:40:43.667724 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Jul 29 04:40:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:40:43.678009 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-31df3311-2118-4639-8de3-351cccbbed35 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:43.683412 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.wsgi [None req-31df3311-2118-4639-8de3-351cccbbed35 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-31df3311-2118-4639-8de3-351cccbbed35 admin admin] Request method failure captured: Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Accept: application/json Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Accept-Encoding: gzip, deflate Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Connection: keep-alive Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Content-Length: 0 Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Host: 10.222.0.40 Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Openstack-Api-Version: compute 2.90 Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Openstack-System-Scope: None Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: User-Agent: python-novaclient Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Auth-Token: gAAAAABi42TKbiuN5A0vSRpvclNM1w2Rnpc30YxElGGE7sTM4xPulaQTvcxTnBC7KwGLmD6xvC980wXkaQ_Dka15htrXXvWSXIMCv462d3Q4SpIcXnGHvg28SeTkjOT10xkeh1-oICGLx-VUBDBvXdGqz4ekGSqmQ7J9540nePU2plinbd0fC4A Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Domain-Id: None Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Domain-Name: None Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Identity-Status: Confirmed Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Is-Admin-Project: True Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Domain-Id: default Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Domain-Name: Default Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Project-Name: admin Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Role: admin,reader,member Jul 29 04:40:43.684970 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Roles: admin,reader,member Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/25a26196f3ac436c876fd26eb5482e4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant: admin Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant-Id: 25a26196f3ac436c876fd26eb5482e4a Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-Tenant-Name: admin Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User: admin Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Domain-Id: default Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Domain-Name: Default Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Id: cfc9fe47ed4740a0aaddec545dbaca1a Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: X-User-Name: admin Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: method: > Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: exception: Flavor 451 could not be found. Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: action_args: {'id': '451'} Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:40:43.687190 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:43.688257 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: ERROR nova.api.openstack.wsgi Jul 29 04:40:43.689576 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-31df3311-2118-4639-8de3-351cccbbed35 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:40:43.690855 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-31df3311-2118-4639-8de3-351cccbbed35 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011885 Jul 29 04:40:43.690855 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 29 04:40:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 29 04:40:44.651394 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:44.652403 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 29 04:40:44.652824 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:45.178928 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-d35814da-1e7f-4f75-8e4e-712f8144a30d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:45.198178 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-d35814da-1e7f-4f75-8e4e-712f8144a30d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408298 Jul 29 04:40:45.198721 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 29 04:40:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:46.159132 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:46.160178 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 29 04:40:46.160571 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:46.684779 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-b8c0ee1b-9a9d-4795-aeef-7759bee6cab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:46.703400 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-b8c0ee1b-9a9d-4795-aeef-7759bee6cab5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403397 Jul 29 04:40:46.703954 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 29 04:40:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:47.685539 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:47.686793 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 29 04:40:47.687340 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:48.206552 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-d5d19bfc-73da-4039-8b6c-04dae0a2e3cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:48.225352 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-d5d19bfc-73da-4039-8b6c-04dae0a2e3cb admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398452 Jul 29 04:40:48.225895 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 29 04:40:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:49.343573 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:49.344572 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 29 04:40:49.344987 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:49.880089 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-ffceecbc-fb8b-47be-ad51-4aed50d903e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:40:49.898540 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-ffceecbc-fb8b-47be-ad51-4aed50d903e5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.415229 Jul 29 04:40:49.899025 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Jul 29 04:40:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:40:50.867386 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:50.868391 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 29 04:40:50.868822 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:40:51.392351 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-b9d48b87-f73b-4721-9404-d139eb540eb7 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:40:51.412705 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-b9d48b87-f73b-4721-9404-d139eb540eb7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405985 Jul 29 04:40:51.413239 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Fri Jul 29 04:40:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:41:42.614917 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:41:42.615924 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-9e9a0820-690d-43df-af65-4ffdee768b34 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 29 04:41:42.616343 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Fri Jul 29 04:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:41:42.627426 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:41:43.008917 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-d978df7a-323c-40f0-ac1c-33e0486ee071 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:41:43.029817 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-d978df7a-323c-40f0-ac1c-33e0486ee071 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406953 Jul 29 04:41:43.030305 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Fri Jul 29 04:41:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:41:43.054215 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-b795f2a4-f885-4501-8daa-a23e8582a5a8 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:41:43.057797 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG dbcounter [-] [115159] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115159) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:41:43.063127 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-b795f2a4-f885-4501-8daa-a23e8582a5a8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012518 Jul 29 04:41:43.063644 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Fri Jul 29 04:41:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:41:43.075092 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-49195542-6c55-43d8-a3c3-e8833d0f98c2 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:41:43.083193 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-49195542-6c55-43d8-a3c3-e8833d0f98c2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011619 Jul 29 04:41:43.083708 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Fri Jul 29 04:41:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:41:43.095467 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:41:43.104272 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012741 Jul 29 04:41:43.104778 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Fri Jul 29 04:41:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:41:43.115957 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-be10a95d-3166-4ee4-8979-02534152ff5b admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:41:43.123744 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-be10a95d-3166-4ee4-8979-02534152ff5b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011282 Jul 29 04:41:43.124259 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Fri Jul 29 04:41:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:45:14.292948 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:14.294050 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jul 29 04:45:14.294453 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:45:14.436932 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_api:SELECT=6 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:14.595285 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-ec735aa3-d781-41e5-80bb-71eb3c1268b0 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:14.597656 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:45:14.597656 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: warnings.warn(msg) Jul 29 04:45:14.598901 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-ec735aa3-d781-41e5-80bb-71eb3c1268b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:14.599347 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-ec735aa3-d781-41e5-80bb-71eb3c1268b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:14.600135 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-ec735aa3-d781-41e5-80bb-71eb3c1268b0 admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:14.600567 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-ec735aa3-d781-41e5-80bb-71eb3c1268b0 admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:14.635497 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-ec735aa3-d781-41e5-80bb-71eb3c1268b0 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200041 Jul 29 04:45:14.636056 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 29 04:45:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:45:15.463458 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:15.464491 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 29 04:45:15.464947 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:45:15.661922 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-7b90de9e-72c8-4e66-b020-a72d9a028ee4 admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:15.664378 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:45:15.664378 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: warnings.warn(msg) Jul 29 04:45:15.666429 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-7b90de9e-72c8-4e66-b020-a72d9a028ee4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:15.666882 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-7b90de9e-72c8-4e66-b020-a72d9a028ee4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:15.667679 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-7b90de9e-72c8-4e66-b020-a72d9a028ee4 admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:15.668111 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-7b90de9e-72c8-4e66-b020-a72d9a028ee4 admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:15.687789 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-7b90de9e-72c8-4e66-b020-a72d9a028ee4 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077990 Jul 29 04:45:15.688359 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 29 04:45:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:45:26.922570 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:26.923588 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Jul 29 04:45:26.923979 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:45:27.068474 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_cell0:SELECT=4 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:27.069224 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_cell1:SELECT=4 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:27.069895 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG dbcounter [-] [115160] Writing DB stats nova_api:SELECT=8 {{(pid=115160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:45:27.121304 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-77d8ccd6-155e-4cfc-aad2-7d0c7792bb5f admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:27.123868 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:45:27.123868 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: warnings.warn(msg) Jul 29 04:45:27.125072 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-77d8ccd6-155e-4cfc-aad2-7d0c7792bb5f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:27.125509 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-77d8ccd6-155e-4cfc-aad2-7d0c7792bb5f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:27.126288 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-77d8ccd6-155e-4cfc-aad2-7d0c7792bb5f admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:27.126767 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-77d8ccd6-155e-4cfc-aad2-7d0c7792bb5f admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:27.152669 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-77d8ccd6-155e-4cfc-aad2-7d0c7792bb5f admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088479 Jul 29 04:45:27.153285 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 29 04:45:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:45:27.983783 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: DEBUG nova.api.openstack.wsgi [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] Calling method '>' {{(pid=115159) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:27.984850 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: INFO nova.api.openstack.requestlog [None req-0fa0c0c0-d070-44ba-b799-f06466433d02 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 29 04:45:27.985249 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: [pid: 115159|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Jul 29 04:45:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:45:28.180198 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG nova.api.openstack.wsgi [None req-812bc8c2-2588-458e-ba99-3f293fd58b0e admin admin] Calling method '>' {{(pid=115160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:45:28.182800 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 04:45:28.182800 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: warnings.warn(msg) Jul 29 04:45:28.183998 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-812bc8c2-2588-458e-ba99-3f293fd58b0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:28.184446 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-812bc8c2-2588-458e-ba99-3f293fd58b0e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:28.185271 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-812bc8c2-2588-458e-ba99-3f293fd58b0e admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:45:28.185710 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: DEBUG oslo_concurrency.lockutils [None req-812bc8c2-2588-458e-ba99-3f293fd58b0e admin admin] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:45:28.207978 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: INFO nova.api.openstack.requestlog [None req-812bc8c2-2588-458e-ba99-3f293fd58b0e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080136 Jul 29 04:45:28.208471 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: [pid: 115160|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Jul 29 04:45:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:46:27.145004 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: Fri Jul 29 04:46:27 2022 - graceful shutdown triggered... Jul 29 04:46:27.145086 dv-cinder-851449-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 29 04:46:27.146106 dv-cinder-851449-2-iscsi devstack@n-api.service[115159]: Gracefully killing worker 1 (pid: 115159)... Jul 29 04:46:27.146541 dv-cinder-851449-2-iscsi devstack@n-api.service[115160]: Gracefully killing worker 2 (pid: 115160)... Jul 29 04:46:28.147197 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: worker 1 buried after 1 seconds Jul 29 04:46:28.147728 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: worker 2 buried after 1 seconds Jul 29 04:46:28.147728 dv-cinder-851449-2-iscsi devstack@n-api.service[115158]: goodbye to uWSGI. Jul 29 04:46:28.148840 dv-cinder-851449-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 29 04:46:28.149692 dv-cinder-851449-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 29 04:46:28.152544 dv-cinder-851449-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 04:46:28.161521 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 04:46:28 2022] *** Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: nodename: dv-cinder-851449-2-iscsi Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: machine: x86_64 Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: clock source: unix Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: pcre jit disabled Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: detected number of CPU cores: 4 Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: current working directory: / Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: detected binary path: /usr/bin/uwsgi-core Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: your processes number limit is 47680 Jul 29 04:46:28.163484 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: your memory page size is 4096 bytes Jul 29 04:46:28.164319 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: detected max file descriptor number: 2048 Jul 29 04:46:28.164319 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: lock engine: pthread robust mutexes Jul 29 04:46:28.164319 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: thunder lock: enabled Jul 29 04:46:28.164319 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 04:46:28.164319 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 04:46:28.204496 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: Python main interpreter initialized at 0x555ed76779c0 Jul 29 04:46:28.204496 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: python threads support enabled Jul 29 04:46:28.204496 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: your server socket listen backlog is limited to 100 connections Jul 29 04:46:28.204496 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: your mercy for graceful operations on workers is 90 seconds Jul 29 04:46:28.204972 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 04:46:28.204972 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: *** Operational MODE: preforking *** Jul 29 04:46:28.205240 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: *** uWSGI is running in multiple interpreter mode *** Jul 29 04:46:28.205240 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: spawned uWSGI master process (pid: 129666) Jul 29 04:46:28.205446 dv-cinder-851449-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 04:46:28.208077 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: spawned uWSGI worker 1 (pid: 129683, cores: 1) Jul 29 04:46:28.208077 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: spawned uWSGI worker 2 (pid: 129684, cores: 1) Jul 29 04:46:28.208077 dv-cinder-851449-2-iscsi devstack@n-api.service[129666]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 04:46:28.875905 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 04:46:28.882041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 04:46:30.040537 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:46:30.040537 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: from cryptography.utils import int_from_bytes Jul 29 04:46:30.041328 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:46:30.041328 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: from cryptography.utils import int_from_bytes Jul 29 04:46:30.047913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:46:30.047913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: from cryptography.utils import int_from_bytes Jul 29 04:46:30.048364 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 04:46:30.048364 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: from cryptography.utils import int_from_bytes Jul 29 04:46:32.504323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 04:46:32.504323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 04:46:32.505035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 04:46:32.505327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 04:46:32.505448 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 04:46:32.505846 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.506206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.506507 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.506933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.507180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.507542 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.507870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.508683 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 04:46:32.509895 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.509985 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 04:46:32.510069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.510069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.510239 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 04:46:32.510329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.510412 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 04:46:32.510483 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-2-iscsi {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.510561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 04:46:32.510633 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.510707 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.510776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.510850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.511165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.511350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.511506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.511657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.511801 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.511951 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.512104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.512256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.512411 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.512566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.512742 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.512897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.513104 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.513299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.513585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.513919 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-2-iscsi {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.514252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.514587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.514816 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.515024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.515232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.515448 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.515657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.515908 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.516130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.516357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.516565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.516845 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.517062 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.517296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.517533 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.517767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.517989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.518205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.518427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.518643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.518881 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.519098 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-2-iscsi {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.519310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.519527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.519721 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.519918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.520075 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.520226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.520399 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.520574 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.520759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.520922 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.521109 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.521278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.521438 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.521592 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.521744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-2-iscsi {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.521897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.522482 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.522636 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.522790 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.522935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.522935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.523268 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.523425 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.523671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.524295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.524295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.524864 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.525056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.525243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.525445 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.525602 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.525755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.525907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.526058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.526211 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.526385 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.526385 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.526804 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.527296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.527455 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.527614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.527759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.527903 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.528053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.528205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.528356 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.528508 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.528718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.528887 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.529041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.529192 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.529355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.529517 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.529673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.529815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.529965 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.530116 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.530338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.530491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.530642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.530796 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.530946 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.531096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.531255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.531400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.531552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.531708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.531858 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.532016 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.532284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.532565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.532840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.533000 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.533152 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.533359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.533518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.533688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.533921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.534104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.534371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.534568 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.534949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.535100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.535251 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.535412 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.535566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.535711 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.535863 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.536006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.536156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.536311 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.536469 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.536649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.536800 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.536955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.537105 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.537256 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.537419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.537572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.537724 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.537875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.537875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.538170 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.538170 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.538452 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.538593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.538743 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.538743 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.539033 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.539195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.539342 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.540045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.540212 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.540366 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.540524 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.540721 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.540879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.541024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.541173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.541323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.541481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.541624 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.541786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.541953 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.542104 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.542264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.542515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.542836 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.543162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.543324 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.543656 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.543805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.543980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.544225 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.544400 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.545291 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.545469 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.545694 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.545842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.545842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.546114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.546257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.546406 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.546559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.546559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.547122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.547276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.547419 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.547579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.547732 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.547875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.547875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.548144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.548294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.548447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.548629 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.548778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.548920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.549078 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.549261 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.549430 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.549601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.549746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.549888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.550065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.550340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.550515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.550671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.550815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.550969 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.551120 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.551271 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.551425 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.551579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.551721 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.551862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.552004 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.552153 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.552316 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.552487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.552952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.553127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.553370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.553568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.553727 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.553871 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.554036 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.554180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.554437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.554589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.556721 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.556909 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.557060 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.557212 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.557357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.557515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.557668 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.557818 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.557969 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.558124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.558268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.558425 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.558578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.558723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.558872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.559015 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.559157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.559311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.559455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.559605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.559758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.559902 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.560054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.560218 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.560372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.560517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.560517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.560848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.561001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.561152 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.561302 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.561451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.561603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.561746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.561908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.562059 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.562202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 04:46:32.562345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.562493 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.562643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.563152 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.563316 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.563617 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.563773 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.563926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.564080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.564080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.564475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.564769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.565017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.565174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.565329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.565575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.565733 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.565885 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.566038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.566190 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.566343 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.566487 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.566824 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.566996 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.567144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.567287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.567430 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.567430 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.567712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.567862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.568014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.568014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.568305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.568305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.568628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.568803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.568948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.569090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.569234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.569386 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.569538 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.569682 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.569831 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.569981 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.570136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.570288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.570467 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.571673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.571858 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.572005 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.572204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.572351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.572494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.572685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.572843 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.572987 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.573422 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.573422 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.573867 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.574018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.574162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.574317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.574473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.574625 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.574787 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.575044 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.575312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.575478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.575711 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.575869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.576015 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.576166 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.576318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.576318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.576657 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.576827 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.577137 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.577284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.577427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.577586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.577731 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.577874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.578023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.578166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.578319 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.578472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.578641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.578641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.578915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.579063 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.579213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.579364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.579508 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.579649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.579800 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.579943 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.580094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.580253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.580401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.580401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.580706 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.580850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581004 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.581857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.582145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.582295 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.582460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.582611 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.582764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.582915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.582915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.583195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.583577 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.583741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.584310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.584477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.584670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.584670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.584972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.585254 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.585543 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.585725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.585725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.586270 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.586421 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.586574 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.586726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.587266 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.587440 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.587440 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.587733 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.588551 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.588877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.589054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.589211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.589356 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.589356 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.589646 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.589788 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.589931 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.590074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.590218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.590374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.590374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.590680 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.590834 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.590985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.591129 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.591129 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.591423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.591566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.591708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.591850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.591992 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.592148 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.592293 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.592446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.592589 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.592779 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.592939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.593083 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.593226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.593377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.593814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.594034 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.594306 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.594471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.594623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.594767 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.594929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.595074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.595323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.595687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.595844 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.596089 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.596248 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.596393 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.596552 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.596733 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.596894 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.597039 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.597182 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.597528 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.597691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.597836 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.597988 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.598141 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.598286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.598445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.598590 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.598733 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.598883 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.601451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.601629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.601872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.601872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.602808 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.602971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.603129 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.603285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.603447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.603594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.604066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.604257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.604518 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.604705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.604854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.604998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.605153 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.605297 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.605510 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.605869 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.606021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.606267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.606419 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.606564 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.606718 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.606877 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.607023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.607173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.607374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.607766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.607922 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.608079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.608233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.608387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.608770 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.608933 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.609089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.609233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.609590 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.609747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.609900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.610152 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.610314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.610543 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.610707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.610852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.611003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.611156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.611310 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.611462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.611607 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.611750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.611901 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.612045 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.612045 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.612354 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.612499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.612680 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.612680 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.612961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.613122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.613283 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.613435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.613586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.613586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.613906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.613906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.614488 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.614488 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.614892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.615044 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.615205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.615358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.615516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.615668 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.615999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.616166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.616418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.616418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.616753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.616929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.617090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.617090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.618968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.619136 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.619297 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.619297 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.619587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.619587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.619892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.620059 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.620211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.620372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.620528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.620721 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.620878 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.621035 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.621194 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.621352 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.621505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.621671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.621831 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.621991 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.622150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.622309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.622473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.622633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.622786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.622935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.623092 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.623243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.623407 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.623565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.623718 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.623875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.624045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.624475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.624667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.624951 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.625110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.625269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.625428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.625586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.625763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.625934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.626269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.626444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.626859 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.627123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.627292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.627453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.627619 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.627769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.627929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.628246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.628413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.628573 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.628778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.628930 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.629083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.629245 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.629398 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.629547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.629704 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.629867 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.630027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.630193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.630344 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.630494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.630847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.631006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.631168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.631334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.631488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.631637 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.631786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.631958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.632118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.632278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.632430 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.632580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.632757 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.632945 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.633998 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.634175 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.634761 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.634937 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.635298 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.635570 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.635750 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.635911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.636070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.636449 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.636653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.636905 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.637076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.637229 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.637596 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.638459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.638623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.638791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.638944 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.639116 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.639268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.639268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.639556 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.639722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.639883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.640047 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.640213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.640213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.640514 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.640702 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.640858 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.640858 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.641171 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.641171 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.641171 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.641624 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.641783 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.641933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.642102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.642253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.642411 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.642562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.642713 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.642863 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.643040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.643200 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.643359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.643532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.643685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.643835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.643985 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.644134 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.644285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.644449 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.644914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.645081 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.645233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.645408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.645586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.645839 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.646014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.646173 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.646345 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.646659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.646818 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.647064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.647231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.647390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.647553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.647705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.647883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.649212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.649930 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.650105 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.650105 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.650554 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.650739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.650903 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.651057 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.651216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.651377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.651536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.651697 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.651868 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.652021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.652172 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.652341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.652502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.654578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.656387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.656582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.657040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.657302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.657473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.657637 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.657813 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.657975 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.658136 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.658299 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.658463 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.658797 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.658957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.659109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.659269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.659437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.659597 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.659757 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.659920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.660071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.660220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.660385 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.660548 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.660548 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.660882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.660882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.661204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.661364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.661517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.661676 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.661836 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.662020 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.662185 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.662345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.662507 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.662666 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.662817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.663110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.663292 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.663455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.663607 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.663765 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.663917 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.664067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.664371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.664595 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.665311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.665755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.665929 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.666137 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.666302 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.666584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.666753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.667106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.667293 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.667538 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.667703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.667870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.668029 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.668230 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.668389 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.668551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.668952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.669122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.669282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.669434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.669593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.669759 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.669919 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.670083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.670243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.670402 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.670562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.670714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.671512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.671685 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.672711 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.672884 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.673040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.673199 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.673351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.673528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.673681 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.673838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.674003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.674158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.674323 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.674475 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.674625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.674782 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.674943 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.675097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.675376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.675584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.676005 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.676168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.676329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.676490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.676817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.676995 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.677335 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.677512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.677751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.677917 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.678084 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.678246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.678418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.678572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.678723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.679054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.679227 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.679381 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.679531 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.679681 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.680352 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.680527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.681352 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.681532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682357 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682538 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.682704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.683922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.683922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.683922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.684355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.684536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.684726 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.684882 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.684882 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.685239 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.685390 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.685673 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.685860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.686528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.686845 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.687005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.687575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.687780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.687970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688125 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688328 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688421 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688864 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.688948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.689061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.689174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.689260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.689344 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.689427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.689523 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690331 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690504 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.690952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691036 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691242 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.691777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.692415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693628 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693720 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693813 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.693997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694090 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694335 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694425 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694509 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694685 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694778 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.694954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.695046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.695132 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.695216 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.695309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.695417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.695582 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.696260 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.696388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.696666 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.696782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.696873 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.696957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697048 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697393 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697542 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697638 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697732 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697824 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.697918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698190 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698614 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698783 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.698970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699148 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699328 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699412 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699756 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699844 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.699928 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700011 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700260 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700520 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700618 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700618 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700804 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700888 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.700978 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701154 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701248 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701332 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.701870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702032 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702306 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702399 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702583 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702676 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702761 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702844 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.702926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703009 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703273 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703440 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703522 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703612 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703790 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.703962 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704238 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704338 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704424 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704658 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.704938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705126 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705483 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705739 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705841 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.705934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706297 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706388 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.706865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707030 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707208 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707719 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.707969 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708258 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708730 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.708911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.709064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.709157 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.709251 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.709428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.709585 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.709740 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.709892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.710053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.710204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.710355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.710506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.710669 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.710829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.711003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.712124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.712303 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.712458 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.712670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.712853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.713017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.713169 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.713330 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.713490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.713654 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.713806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.713979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714153 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714671 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714901 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.714984 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715063 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715063 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715190 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715266 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715411 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715605 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.715936 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716208 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716292 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716403 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716583 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.716737 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.717887 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718260 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718364 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718805 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718902 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.718998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719084 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719448 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719624 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719722 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.719993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720085 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720261 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720688 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720789 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720789 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.720961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721227 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721394 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721590 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721683 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.721859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722442 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722602 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.722948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723224 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723224 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723394 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723479 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723707 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.723983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724556 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.724934 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725024 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725024 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725323 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725591 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725830 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.725926 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726102 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726358 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726449 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726534 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726624 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726624 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.726846 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.727620 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.727736 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.727839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.727926 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728050 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728247 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728331 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728422 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728629 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.728734 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.729095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.729271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.729374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.729536 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.729694 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.729825 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.729825 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730045 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730241 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730850 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.730972 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731464 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.731898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.732976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733161 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733255 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733506 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733597 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733696 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733840 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.733940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734395 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734893 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.734988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735720 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.735943 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736050 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736137 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736222 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736312 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736399 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736483 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736726 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736825 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.736919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737095 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737440 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737787 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737878 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.737963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738048 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738126 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738290 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738290 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738720 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.738960 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739402 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739658 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739744 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739841 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.739934 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740019 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740111 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740203 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740289 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740467 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740550 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740772 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740867 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.740967 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741059 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741146 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741574 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.741989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.742077 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.742162 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.742246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.742854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.742944 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.743652 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.743752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.743847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.743921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.743999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744192 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744492 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744843 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.744980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.745157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.745250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.745479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.745583 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.745793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.745888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.746118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.746214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.746496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.746587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.746819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.746912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.747147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.747247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.747472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.747565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.747796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.747900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.748106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.748206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.748425 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.748529 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.748775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.748870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.749119 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.749227 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.749493 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.749598 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.749747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.749841 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.750156 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.750249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.750485 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.750634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.750814 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.751036 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.751152 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.751379 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.751481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.751710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.751803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.752052 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.752147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.752393 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.752495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.752734 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.752844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.753051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.753145 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.753367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.753474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.753702 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.753797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.754024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.754125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.754345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.754439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.754664 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.754765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.754976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.755114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.755293 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.755396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.755609 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.755705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.755930 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.756068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.756250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.756351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.756562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.756672 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.756900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.756995 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.757218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.757320 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.757532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.757630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.757848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.757969 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.758240 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.758830 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.758927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759013 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759258 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759349 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759592 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759780 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.759958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.760164 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.760261 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.760491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.760587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.760880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.760976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.761198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.761306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.761513 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.761641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.761829 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.761979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.762162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.762288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.762451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.762544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.762750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.762917 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.763100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.763240 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.763442 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.763562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.763770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.763869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.764106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.764215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.764419 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.764525 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.764776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.764881 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.765101 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.765358 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.765536 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.765641 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.765820 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.765963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.766058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.766284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.766378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.766474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.766692 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.766786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.767009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.767110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.767333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.767428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.767650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.767743 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.767964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.768058 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.768277 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.768379 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.768595 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.768716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.768941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.769046 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.769262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.769356 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.769638 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.769784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.769898 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.770009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.770182 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.770312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.770495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.770596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.770806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.770912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.771124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.771237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.771438 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.771541 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.771754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.771941 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.772064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.772169 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.772377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.772473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.772712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.772829 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.773028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.773124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.773342 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.773444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.774177 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.774831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.774981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.775140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.775247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.775389 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.775548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.775689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.775830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.775972 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.776114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.776264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.776416 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.776557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.776715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.776874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.777026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.777026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.777312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.777453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.777601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.777749 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.777890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.778038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.778179 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.778336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.778485 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.778581 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.778744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.779048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.779219 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.779471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 04:46:32.779753 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.780049 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.780402 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.780753 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.781083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.781407 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.781730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.782054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.782379 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.782717 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.783053 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.783371 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.783705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.784031 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.784359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.784714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.785038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.785383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.785703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.786022 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.786340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.786662 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.786981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.787305 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.787627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.787955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.788271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.788595 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.788955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.789362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.789687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.790023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.790374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.790712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.791034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.791386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.791723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.792046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.792369 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.792703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 04:46:32.792955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 04:46:32.843407 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO dbcounter [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Registered counter for database nova_api Jul 29 04:46:32.856687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO dbcounter [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Registered counter for database nova_api Jul 29 04:46:32.864758 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_db.sqlalchemy.engines [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:32.872082 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writer thread running {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:32.876920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_db.sqlalchemy.engines [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:32.884066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writer thread running {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:32.928685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.context [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4aee4dd5-d750-4ce7-b7ef-1adbdadced01(cell1) {{(pid=129684) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 04:46:32.934000 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:46:32.936717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:46:32.937525 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:46:32.939392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.context [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4aee4dd5-d750-4ce7-b7ef-1adbdadced01(cell1) {{(pid=129683) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 04:46:32.939529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:46:32.941516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO dbcounter [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Registered counter for database nova_cell0 Jul 29 04:46:32.943550 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:46:32.946094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO dbcounter [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Registered counter for database nova_cell1 Jul 29 04:46:32.947538 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:46:32.948438 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:46:32.950516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:46:32.952635 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO dbcounter [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Registered counter for database nova_cell0 Jul 29 04:46:32.953937 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_db.sqlalchemy.engines [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:32.956260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_db.sqlalchemy.engines [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:32.956961 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO dbcounter [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Registered counter for database nova_cell1 Jul 29 04:46:32.960839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writer thread running {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:32.964948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_db.sqlalchemy.engines [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:32.968936 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_db.sqlalchemy.engines [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:32.970793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writer thread running {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:33.104642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writer thread running {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:33.112887 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writer thread running {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:33.114561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO dbcounter [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Registered counter for database nova_cell0 Jul 29 04:46:33.121762 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_db.sqlalchemy.engines [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:33.122437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO dbcounter [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Registered counter for database nova_cell0 Jul 29 04:46:33.129544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_db.sqlalchemy.engines [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 04:46:33.130227 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writer thread running {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:33.136877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writer thread running {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 04:46:33.457430 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: WARNING keystonemiddleware.auth_token [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:46:33.459105 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: WARNING keystonemiddleware.auth_token [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:46:33.466380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: WARNING keystonemiddleware.auth_token [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:46:33.466965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: WARNING keystonemiddleware.auth_token [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:46:33.818897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: WARNING keystonemiddleware.auth_token [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:46:33.821781 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: WARNING keystonemiddleware.auth_token [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 04:46:33.825514 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: WARNING keystonemiddleware.auth_token [None req-f74ebe63-7247-4fe4-ac14-99dd430b4157 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:46:33.827827 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: WARNING keystonemiddleware.auth_token [None req-90f662c6-7052-4b3c-8175-8c24dd7aa816 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 04:46:33.830860 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555ed76779c0 pid: 129683 (default app) Jul 29 04:46:33.833710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555ed76779c0 pid: 129684 (default app) Jul 29 04:47:15.688584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:15.698816 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:15.702321 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:15.707343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:17.179383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7d9f8f81-ba05-4375-951f-c509eff5c7c0 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Action: 'create', calling method: .version_select at 0x7f3c56330ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-155519742"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:19.342487 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7d9f8f81-ba05-4375-951f-c509eff5c7c0 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.677225 Jul 29 04:47:19.353776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Jul 29 04:47:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3694 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 04:47:19.362155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:19.362966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:19.367230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:19.370202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:19.998149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-de8abf59-be0d-4d00-8b2c-d3c5a5607cbc tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c56328b80>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:21.160987 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-de8abf59-be0d-4d00-8b2c-d3c5a5607cbc tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157" status: 200 len: 345 microversion: 2.1 time: 1.804981 Jul 29 04:47:21.163018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 1/2] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:47:19 2022] GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 => generated 345 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:21.177698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-dbe963cf-4f27-42a6-b71a-2f46c9873af2 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Action: 'create', calling method: .version_select at 0x7f3c561b4ca0>, body: {"snapshot": {"volume_id": "abc0be98-e36a-4cf1-ada6-e52f2e7ed157", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-310765135"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:21.643641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-dbe963cf-4f27-42a6-b71a-2f46c9873af2 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.469669 Jul 29 04:47:21.652707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 2/3] 10.222.0.40 () {60 vars in 1162 bytes} [Fri Jul 29 04:47:21 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:21.657483 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-15aea4d7-32ca-48a0-871e-75ab4d7460a1 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561eed30>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:21.743810 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-15aea4d7-32ca-48a0-871e-75ab4d7460a1 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.091354 Jul 29 04:47:21.745006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:21 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:21.756781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-95a21f20-f2c4-4fc4-9fde-43df08c77298 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561c5e50>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:21.886006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-95a21f20-f2c4-4fc4-9fde-43df08c77298 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.134286 Jul 29 04:47:21.887021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Jul 29 04:47:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:21.899803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4445f743-3d8a-4fbb-8a44-347bd329dbd1 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561ab4c0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:21.981217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4445f743-3d8a-4fbb-8a44-347bd329dbd1 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.086452 Jul 29 04:47:21.982139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:21 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:22.995385 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-45345662-deff-4c6d-93ba-d6f7091e93d3 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561c5ca0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:23.137080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-45345662-deff-4c6d-93ba-d6f7091e93d3 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.145409 Jul 29 04:47:23.142988 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:22 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:24.151719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1276dfce-5bd0-49ec-82a2-0704d7c001e1 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561abb80>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:24.206524 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1276dfce-5bd0-49ec-82a2-0704d7c001e1 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.061127 Jul 29 04:47:24.207095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:24 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:25.219228 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e7be8cbb-10df-4ad3-bb94-e928e51d1afc tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561c5430>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:25.317234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e7be8cbb-10df-4ad3-bb94-e928e51d1afc tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.101720 Jul 29 04:47:25.317806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:25 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:26.342350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9590b726-2825-4aaa-bd3a-5371b7dbbf16 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561eedc0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:26.422456 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9590b726-2825-4aaa-bd3a-5371b7dbbf16 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.091542 Jul 29 04:47:26.427964 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:26 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:26.860639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-461393919", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "networks": [{"uuid": "39e88c0c-eb22-4423-a14a-7cac22367ce7"}]}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:27.121340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] validate_networks() for [('39e88c0c-eb22-4423-a14a-7cac22367ce7', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:47:27.436670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f4bc9d09-eadf-4f51-bfac-8ad8fec2f28d tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561aba60>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:27.500052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f4bc9d09-eadf-4f51-bfac-8ad8fec2f28d tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.068038 Jul 29 04:47:27.501372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:27 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:28.532229 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0032c97a-274b-4608-9c38-d2acdf2a5c2a tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561ab3a0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:28.627082 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0032c97a-274b-4608-9c38-d2acdf2a5c2a tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.116035 Jul 29 04:47:28.628119 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 7/12] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:28 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:29.641268 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c51ee75a-e66f-4f8e-92ae-6710fb853413 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c561bd310>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:29.726585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c51ee75a-e66f-4f8e-92ae-6710fb853413 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 287 microversion: 2.1 time: 0.089632 Jul 29 04:47:29.727531 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 8/13] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:29 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:47:30.055970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-784144259", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:30.326768 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] validate_networks() for [('3e84cf4e-559b-4bbd-af56-3f6353c004d0', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:47:31.295588 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:47:31.296103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:47:31.297669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:47:31.298095 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:47:31.299090 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:47:31.343952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:31.344408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:31.345250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:31.345701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:31.418040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Getting quotas for project 77688c4faed945849f5649c08cc580c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:47:31.436250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Getting quotas for user 34242a2360f14710af2e8dbe6b704ca1 and project 77688c4faed945849f5649c08cc580c2. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:47:31.463656 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:47:31.466931 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:47:31.639780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bcdbeb39-068a-4b60-b9c0-a80fac1bb5af tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.310288 Jul 29 04:47:31.640661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 6/14] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 5312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:47:31.655998 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-385bf8de-c948-4106-92c1-1809395acf67 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c560cd9d0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:31.796018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:47:31.796857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:47:31.798508 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:47:31.799147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:47:31.800640 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:47:31.808738 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-385bf8de-c948-4106-92c1-1809395acf67 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 202 len: 0 microversion: 2.1 time: 0.166820 Jul 29 04:47:31.809329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 7/15] 10.222.0.40 () {58 vars in 1254 bytes} [Fri Jul 29 04:47:31 2022] DELETE /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:47:31.863184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:31.865516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:31.866671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:31.867731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:31.931412 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-74fad80e-f87f-4516-9565-53ec08300aa9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'create', calling method: .version_select at 0x7f3c560cd670>, body: {"keypair": {"name": "tempest-keypair-1057391386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODkUEq3ohh2MXSwNuIQU7RiQQ+rN2QSCc3tZVPwbhanzFbMDCQON2TGAH8hS6zfhoSJmqoUF6u7fsr8iM80yjPhPTOrfCHU3564yg8gCHE989uHpcW3jrwuZfYSE6J26A=="}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:31.954107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:47:31.966626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for user 5f9d45265c6f47609f9f8abcf3526ff0 and project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:47:31.985457 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-74fad80e-f87f-4516-9565-53ec08300aa9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for project 946bf1e173f9476d86cf6133055fba0a. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:47:31.991274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-74fad80e-f87f-4516-9565-53ec08300aa9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for user 8b7751b93f88424abebe6859f46f8351 and project 946bf1e173f9476d86cf6133055fba0a. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:47:31.999631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:47:32.004232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:47:32.108279 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-74fad80e-f87f-4516-9565-53ec08300aa9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.295447 Jul 29 04:47:32.129778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 8/16] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:47:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:32.143611 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5a0233bd-5623-4792-ada9-f808bc13d035 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:32.158481 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5a0233bd-5623-4792-ada9-f808bc13d035 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:32.286501 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ad94e5d0-00da-4d0f-9695-e3524ad64d5c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.557590 Jul 29 04:47:32.287714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 9/17] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:47:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:47:32.295659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-30c1dbd2-97ea-4749-87a8-55cbf0f951a8 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c558d54c0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:32.436315 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-30c1dbd2-97ea-4749-87a8-55cbf0f951a8 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.147154 Jul 29 04:47:32.437755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 10/18] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:32 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:32.442485 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5a0233bd-5623-4792-ada9-f808bc13d035 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:32.447926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-937bd58a-53dd-4b61-856b-0c159b1c79a0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:32.450816 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-937bd58a-53dd-4b61-856b-0c159b1c79a0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:32.512066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5a0233bd-5623-4792-ada9-f808bc13d035 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1214 microversion: 2.1 time: 0.376838 Jul 29 04:47:32.512704 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 9/19] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:32 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1214 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:32.745505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-937bd58a-53dd-4b61-856b-0c159b1c79a0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:32.781576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-937bd58a-53dd-4b61-856b-0c159b1c79a0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1221 microversion: 2.1 time: 0.342463 Jul 29 04:47:32.787247 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 11/20] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:32 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1221 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:32.935470 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1712101671", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:33.185167 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] validate_networks() for [('3e84cf4e-559b-4bbd-af56-3f6353c004d0', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:47:33.459100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-12252480-053f-4383-b60c-b437bd72423e tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c5506d280>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:33.544768 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-12252480-053f-4383-b60c-b437bd72423e tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.098126 Jul 29 04:47:33.545353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 12/21] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:33 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:33.553599 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-190b0058-0fb8-453b-a8f8-04c10c218572 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:33.554459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-190b0058-0fb8-453b-a8f8-04c10c218572 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:33.741461 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-190b0058-0fb8-453b-a8f8-04c10c218572 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:33.753501 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-190b0058-0fb8-453b-a8f8-04c10c218572 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1214 microversion: 2.1 time: 0.205868 Jul 29 04:47:33.756011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 13/22] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:33 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:34.559492 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-22b66366-8247-42dd-a974-d5fd9dd33103 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c5507faf0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:34.613133 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:47:34.615003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:47:34.616217 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:47:34.616659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:47:34.618176 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:47:34.642132 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-22b66366-8247-42dd-a974-d5fd9dd33103 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.086948 Jul 29 04:47:34.642707 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 14/23] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:34 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:34.669394 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:34.671634 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:34.673626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:34.678899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:34.729941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:47:34.741958 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for user 5f9d45265c6f47609f9f8abcf3526ff0 and project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:47:34.773325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:47:34.775515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:34.776147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:34.780116 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:47:34.789338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:34.790083 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:34.792571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:34.794233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:34.912372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-13015faf-a32c-4420-ac0c-9c07fa1c252d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.981666 Jul 29 04:47:34.917557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 10/24] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:47:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:47:34.934100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a4a2cd7b-f945-4c79-8985-0467d73c70b1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:34.935052 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a4a2cd7b-f945-4c79-8985-0467d73c70b1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:35.376325 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:35.406738 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a4a2cd7b-f945-4c79-8985-0467d73c70b1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:35.419600 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a4a2cd7b-f945-4c79-8985-0467d73c70b1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1222 microversion: 2.1 time: 0.490336 Jul 29 04:47:35.422204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 11/25] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:34 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1222 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:35.435752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1408fa8e-19a8-495b-b253-6059f45e8bf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1218 microversion: 2.1 time: 0.664736 Jul 29 04:47:35.436851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 15/26] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:34 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1218 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:35.671845 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-19aa8ac9-b600-4b1e-bcef-dec13d9e4b14 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c5482e0d0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:35.786172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-19aa8ac9-b600-4b1e-bcef-dec13d9e4b14 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.130961 Jul 29 04:47:35.788479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 12/27] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:35 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:36.041100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f24ad57d-d459-4b95-818e-d32c19017132 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: .version_select at 0x7f3c550063a0>, body: {"keypair": {"name": "tempest-keypair-1755824665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiH6QjX5jCcNA005EV3oNfUsduvdQQYgtGTc3lNSXRsgHv/KzEoEKPLGP0JmyUFubp8s6MhPk+uAj9FVJuUSNmiVTaXb35b/TIfYNLhMak4twHXyh44bXuxyDj8jnnn2g=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:36.115920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-f24ad57d-d459-4b95-818e-d32c19017132 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:47:36.135634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-f24ad57d-d459-4b95-818e-d32c19017132 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:47:36.226429 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f24ad57d-d459-4b95-818e-d32c19017132 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.340247 Jul 29 04:47:36.229773 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 16/28] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:47:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:36.266018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1657945996", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bcca997-0807-424d-86d3-43681c4961dd"}], "security_groups": [{"name": "tempest-securitygroup--2008718860"}], "key_name": "tempest-keypair-1057391386", "user_data": "}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:36.450584 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:36.451557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:36.475462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:36.475937 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:36.476763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:36.477219 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:36.536070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] validate_networks() for [('4bcca997-0807-424d-86d3-43681c4961dd', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:47:36.648446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:36.660730 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3bc70463-5029-4263-be19-8e381aeeef1c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1226 microversion: 2.1 time: 0.216444 Jul 29 04:47:36.680313 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 17/29] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:36 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1226 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:36.688417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:36.689254 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:36.701010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:36.702261 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:36.704007 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:36.704620 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:36.976737 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:36.999904 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-25060533-57ab-42e8-bbb8-49067b9726b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1210 microversion: 2.1 time: 0.320193 Jul 29 04:47:37.025087 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 18/30] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:36 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1210 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:37.049561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-874bc1c0-3159-4e01-b4e0-59a6d3a03084 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c54fda670>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:37.111376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-874bc1c0-3159-4e01-b4e0-59a6d3a03084 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 200 len: 286 microversion: 2.1 time: 0.085145 Jul 29 04:47:37.112541 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 19/31] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:37 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:37.231498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:47:37.231969 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:47:37.234054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:47:37.234495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:47:37.234900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:47:37.245337 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:37.246589 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:37.247730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:37.248594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:37.271654 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for project 946bf1e173f9476d86cf6133055fba0a. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:47:37.276678 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for user 8b7751b93f88424abebe6859f46f8351 and project 946bf1e173f9476d86cf6133055fba0a. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:47:37.291249 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:47:37.294649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:47:37.361548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-462309cb-2eee-45af-9563-89d585aa36f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.099761 Jul 29 04:47:37.362761 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 13/32] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:47:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:47:37.374704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d218e649-373c-4506-8589-ae598f79c793 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:37.375328 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d218e649-373c-4506-8589-ae598f79c793 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:37.450878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d218e649-373c-4506-8589-ae598f79c793 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:37.462433 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d218e649-373c-4506-8589-ae598f79c793 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1238 microversion: 2.1 time: 0.090110 Jul 29 04:47:37.477340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 20/33] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:37 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:37.693211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:37.697473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:37.713028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:37.727031 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:37.730634 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:37.733656 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:38.018104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:38.025948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:38.035881 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:38.049978 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-116552b4-169c-414a-b794-b811cce15668 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1274 microversion: 2.1 time: 0.362146 Jul 29 04:47:38.051597 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 14/34] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:37 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1274 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:38.066903 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:38.075591 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:38.077704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:38.080365 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:38.125666 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8742af93-3993-4458-a53a-c2b4fbe9e5a6 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c547b7d30>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:38.219101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-8742af93-3993-4458-a53a-c2b4fbe9e5a6 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] HTTP exception thrown: Snapshot b8038ff1-4677-48f6-ac93-948f9d8de931 could not be found. Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8742af93-3993-4458-a53a-c2b4fbe9e5a6 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Request method failure captured: Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 HTTP/1.1 Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZToqcp1p6aZcesidufIXH631jY7aswEVEgBo82Z-VWbqpL9JxpiOFS5UioDx0yaDYZ3jb4Ueqg356ldD8aQbZNyHyJDwn-JQInlMdjzj1tlUdJtDfe4vU_x8ssa7wwGj5JHkRQoX3emZlQqwUeJDxe_0rHpWUWjyxf0Vl4h0JSBgQ Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:47:38.223292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 865e73a677c0412ab5619e92905526dd Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Snapshot b8038ff1-4677-48f6-ac93-948f9d8de931 could not be found. Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': 'b8038ff1-4677-48f6-ac93-948f9d8de931'} Jul 29 04:47:38.225124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b8038ff1-4677-48f6-ac93-948f9d8de931 could not be found. (HTTP 404) (Request-ID: req-874866cd-11ef-4048-829d-6d768a4ae2ae) Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.225856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:47:38.226830 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b8038ff1-4677-48f6-ac93-948f9d8de931 could not be found. Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 29 04:47:38.227799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b8038ff1-4677-48f6-ac93-948f9d8de931 could not be found. Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b8038ff1-4677-48f6-ac93-948f9d8de931 could not be found. Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8742af93-3993-4458-a53a-c2b4fbe9e5a6 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Returning 404 to user: Snapshot b8038ff1-4677-48f6-ac93-948f9d8de931 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8742af93-3993-4458-a53a-c2b4fbe9e5a6 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931" status: 404 len: 111 microversion: 2.1 time: 0.104401 Jul 29 04:47:38.228919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 15/35] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Jul 29 04:47:38 2022] GET /compute/v2.1/os-snapshots/b8038ff1-4677-48f6-ac93-948f9d8de931 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:47:38.235804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8ebf17b4-eaca-44e6-bbef-708c37953a9c tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c5482d4c0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:38.558998 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8ebf17b4-eaca-44e6-bbef-708c37953a9c tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157" status: 202 len: 0 microversion: 2.1 time: 0.326980 Jul 29 04:47:38.560361 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 16/36] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:47:38 2022] DELETE /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:47:38.567159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:38.568827 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:38.585900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:38.586373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:38.587376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:38.588508 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:38.673827 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:38.689961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-aded52e9-b0bf-4ced-b5f0-12e1ae78f467 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1274 microversion: 2.1 time: 0.669947 Jul 29 04:47:38.697008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 21/37] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:38 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1274 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:38.712996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-487f0110-bc20-4712-817b-b3911e9f7376 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c54ffc8b0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:38.876054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-487f0110-bc20-4712-817b-b3911e9f7376 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] HTTP exception thrown: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-487f0110-bc20-4712-817b-b3911e9f7376 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Request method failure captured: Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 HTTP/1.1 Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZToqcp1p6aZcesidufIXH631jY7aswEVEgBo82Z-VWbqpL9JxpiOFS5UioDx0yaDYZ3jb4Ueqg356ldD8aQbZNyHyJDwn-JQInlMdjzj1tlUdJtDfe4vU_x8ssa7wwGj5JHkRQoX3emZlQqwUeJDxe_0rHpWUWjyxf0Vl4h0JSBgQ Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:47:38.891205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 865e73a677c0412ab5619e92905526dd Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': 'abc0be98-e36a-4cf1-ada6-e52f2e7ed157'} Jul 29 04:47:38.893230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. (HTTP 404) (Request-ID: req-db3ffebd-278f-4a8a-a866-69bf14416e35) Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:38.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:47:38.895544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 04:47:38.897623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:38.899932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:38.903057 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-487f0110-bc20-4712-817b-b3911e9f7376 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Returning 404 to user: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:47:38.908509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-487f0110-bc20-4712-817b-b3911e9f7376 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157" status: 404 len: 109 microversion: 2.1 time: 0.208523 Jul 29 04:47:38.918249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 22/38] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:47:38 2022] GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:47:38.935989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a65fbd37-5c2d-486c-836f-d3286c77dc48 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c54788e50>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:39.084847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:39.095873 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-a65fbd37-5c2d-486c-836f-d3286c77dc48 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] HTTP exception thrown: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.097813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c07d6aa4-f322-47f1-ba71-799772c98431 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1242 microversion: 2.1 time: 0.533217 Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a65fbd37-5c2d-486c-836f-d3286c77dc48 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Request method failure captured: Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 HTTP/1.1 Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZToqcp1p6aZcesidufIXH631jY7aswEVEgBo82Z-VWbqpL9JxpiOFS5UioDx0yaDYZ3jb4Ueqg356ldD8aQbZNyHyJDwn-JQInlMdjzj1tlUdJtDfe4vU_x8ssa7wwGj5JHkRQoX3emZlQqwUeJDxe_0rHpWUWjyxf0Vl4h0JSBgQ Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:47:39.098047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 865e73a677c0412ab5619e92905526dd Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': 'abc0be98-e36a-4cf1-ada6-e52f2e7ed157'} Jul 29 04:47:39.099547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. (HTTP 404) (Request-ID: req-0c920a1d-45d3-4789-b36e-415925eaad3e) Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:39.100187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 04:47:39.101235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 04:47:39.102164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.103071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.103590 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 17/39] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:38 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1242 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:39.103666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a65fbd37-5c2d-486c-836f-d3286c77dc48 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Returning 404 to user: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:47:39.103666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a65fbd37-5c2d-486c-836f-d3286c77dc48 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157" status: 404 len: 109 microversion: 2.1 time: 0.170709 Jul 29 04:47:39.103666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 23/40] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:47:38 2022] DELETE /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:47:39.120998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-17f6b941-061b-49a9-92d6-ce1e8de1cff4 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Calling method '.version_select at 0x7f3c54788820>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:39.123315 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:39.123987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:39.141935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:39.142727 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:39.166652 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:39.167122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:39.441400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:39.450360 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8c18e0e6-2537-4956-8ae1-efbc1acc94de tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1280 microversion: 2.1 time: 0.348257 Jul 29 04:47:39.450949 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 18/41] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:39 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:39.480932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-17f6b941-061b-49a9-92d6-ce1e8de1cff4 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] HTTP exception thrown: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-17f6b941-061b-49a9-92d6-ce1e8de1cff4 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Request method failure captured: Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 HTTP/1.1 Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZToqcp1p6aZcesidufIXH631jY7aswEVEgBo82Z-VWbqpL9JxpiOFS5UioDx0yaDYZ3jb4Ueqg356ldD8aQbZNyHyJDwn-JQInlMdjzj1tlUdJtDfe4vU_x8ssa7wwGj5JHkRQoX3emZlQqwUeJDxe_0rHpWUWjyxf0Vl4h0JSBgQ Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:47:39.484499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84bbb598d5204cad9c8cb378bc09f1c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 84bbb598d5204cad9c8cb378bc09f1c3 Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-127499725 Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 865e73a677c0412ab5619e92905526dd Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesSnapshotsTestJSON-127499725-project Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': 'abc0be98-e36a-4cf1-ada6-e52f2e7ed157'} Jul 29 04:47:39.485650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. (HTTP 404) (Request-ID: req-96180709-242f-4c31-b25a-3144d2f79922) Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:39.486338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:47:39.487255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 04:47:39.488206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. Jul 29 04:47:39.489140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:47:39.491506 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-17f6b941-061b-49a9-92d6-ce1e8de1cff4 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] Returning 404 to user: Volume abc0be98-e36a-4cf1-ada6-e52f2e7ed157 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:47:39.492731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-17f6b941-061b-49a9-92d6-ce1e8de1cff4 tempest-VolumesSnapshotsTestJSON-127499725 tempest-VolumesSnapshotsTestJSON-127499725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157" status: 404 len: 109 microversion: 2.1 time: 0.384102 Jul 29 04:47:39.493608 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 24/42] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:47:39 2022] GET /compute/v2.1/os-volumes/abc0be98-e36a-4cf1-ada6-e52f2e7ed157 => generated 109 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:47:39.714824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:39.715713 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:39.731719 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:39.739045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:39.742470 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:39.745924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:39.968169 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:39.980426 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a9358b31-ee1d-4b95-b59e-4fd81185cffa tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1272 microversion: 2.1 time: 0.269408 Jul 29 04:47:39.996767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 19/43] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:39 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:40.126306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:40.126977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:40.136353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:40.151460 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:40.152318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:40.152812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:40.472722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:40.473356 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:40.489143 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:40.490307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:40.491215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:40.497156 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:40.810095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:40.836784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0a473389-b75a-47f6-a959-d1fbf8b444b2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1296 microversion: 2.1 time: 0.701889 Jul 29 04:47:40.855902 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 25/44] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:40 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1296 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:40.951886 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:40.964856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d99509b3-6e9e-4984-a4c7-756f82b4ca83 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1280 microversion: 2.1 time: 0.494750 Jul 29 04:47:40.968621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 20/45] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:40 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1280 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:41.008899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:41.010921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:41.030873 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:41.032739 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:41.038641 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:41.043164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:41.541218 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:41.557929 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ca528991-7246-407b-943e-833c39ef6b3c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1272 microversion: 2.1 time: 0.557261 Jul 29 04:47:41.558748 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 26/46] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:40 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1272 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:41.862498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:41.863185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:41.872033 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:41.872490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:41.873339 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:41.873756 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:41.996777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:41.998338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:42.027973 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:42.037264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:42.039922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:42.047047 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:42.052935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:42.231532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:42.245289 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-57d92223-1806-4b3a-9816-5e1142ca12eb tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1296 microversion: 2.1 time: 0.386515 Jul 29 04:47:42.245892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 21/47] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:41 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1296 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:42.266641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1466334889", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ca39e1-cfc7-4b5b-897b-220faf26ce68"}], "security_groups": [{"name": "tempest-securitygroup--1323968734"}], "key_name": "tempest-keypair-1755824665", "user_data": "}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:42.621211 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:42.643344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c5722295-49ac-4d0f-be3d-c1e9db2ec705 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1280 microversion: 2.1 time: 0.651101 Jul 29 04:47:42.646957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 27/48] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:41 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1280 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:42.654154 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:42.660344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:42.697948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:42.702581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:42.707797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:42.711221 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:42.854735 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] validate_networks() for [('21ca39e1-cfc7-4b5b-897b-220faf26ce68', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:47:44.934194 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:44.947172 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ef2cd1c2-b08f-4ba9-9912-5ec4f8a02203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 2.298414 Jul 29 04:47:44.949437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 28/49] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:42 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:44.988232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:44.993098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:45.010632 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:45.011376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:45.042580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:45.044379 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:45.545837 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:45.559899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6019372f-2f61-4b2a-acf5-f5e8210db8e0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.606434 Jul 29 04:47:45.574552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 29/50] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:44 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:45.587775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:45.588393 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:45.613142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:45.613596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:45.634467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:45.635031 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:46.230754 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:46.296829 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fa088f24-dbd7-4ab4-9dff-226074592d5f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1280 microversion: 2.1 time: 0.692500 Jul 29 04:47:46.314608 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 30/51] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:45 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1280 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:46.336333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:46.340146 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:46.391622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:46.394454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:46.399405 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:46.402702 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:47.262408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:47.284058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=26 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:47.390965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:47:47.392225 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:47:47.392877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:47:47.393405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:47:47.394414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:47:47.436884 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:47.456008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=16 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:47.457149 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:47.470223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:47.472860 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:47.531979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:47:47.581571 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:47:47.651203 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:47:47.665804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:47:47.838714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:47.872167 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8edd9869-95d3-4179-8ade-1c9635e799d6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.619592 Jul 29 04:47:47.873361 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 22/52] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:47:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 5627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:47:47.880900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:47.881915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:47.890096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:47.891054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:47.892320 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:47.893108 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:48.875096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:48.884955 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fcba0460-a373-4cfa-8f50-e98336a0496a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 2.562622 Jul 29 04:47:48.885741 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 31/53] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:46 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 2570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:48.923674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:48.924506 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:48.958594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:48.959236 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:48.960095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:48.960555 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:49.551572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:49.566265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6823ff08-19a4-456c-997b-6e0c3de54384 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 1.691066 Jul 29 04:47:49.568402 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 23/54] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:47 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:49.583696 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:49.604158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:49.634103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:49.635054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:49.636064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:49.639803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:50.040587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:50.055612 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b8b4401f-adf9-44c3-ae90-96b5ead6c148 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1238 microversion: 2.1 time: 0.485499 Jul 29 04:47:50.056213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 24/55] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:49 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1238 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:50.102907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:50.113494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6c6a78ec-8a6e-4deb-8654-2088f9e2de71 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 1.195630 Jul 29 04:47:50.115445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 32/56] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:48 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:50.121221 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:50.122061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:50.130371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:50.131553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:50.132542 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:50.133204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:50.244570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-616c761b-3d17-40ae-84ce-c96b246c18b3 req-6e3fef20-6c04-48f0-8cbd-c534f6ab9da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5786f4ef-cc00-4e18-9910-7ba1707d903c", "tag": "9311cd5a-7a75-4479-a351-988245db7504"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:50.269637 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-616c761b-3d17-40ae-84ce-c96b246c18b3 req-6e3fef20-6c04-48f0-8cbd-c534f6ab9da0 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:50.270821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-616c761b-3d17-40ae-84ce-c96b246c18b3 req-6e3fef20-6c04-48f0-8cbd-c534f6ab9da0 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:50.319869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-616c761b-3d17-40ae-84ce-c96b246c18b3 req-6e3fef20-6c04-48f0-8cbd-c534f6ab9da0 service nova] Creating event network-changed:9311cd5a-7a75-4479-a351-988245db7504 for instance 5786f4ef-cc00-4e18-9910-7ba1707d903c on hv-cinder-85144 Jul 29 04:47:50.320697 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-616c761b-3d17-40ae-84ce-c96b246c18b3 req-6e3fef20-6c04-48f0-8cbd-c534f6ab9da0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129683) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 04:47:50.322015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b197c601-1bd0-41d2-8428-92379840778d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:50.322691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b197c601-1bd0-41d2-8428-92379840778d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:50.323566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b197c601-1bd0-41d2-8428-92379840778d None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:50.324268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b197c601-1bd0-41d2-8428-92379840778d None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:50.344183 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.compute.rpcapi [None req-b197c601-1bd0-41d2-8428-92379840778d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 04:47:50.345378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b197c601-1bd0-41d2-8428-92379840778d None None] Releasing lock "compute-rpcapi-router" {{(pid=129683) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 04:47:50.373533 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b197c601-1bd0-41d2-8428-92379840778d None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315723 Jul 29 04:47:50.374648 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 25/57] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:50.527454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:50.551725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-20438bf6-0df1-47cb-ad9b-306ab75ee95a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.433218 Jul 29 04:47:50.573315 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 33/58] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:50 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:50.594621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:50.600265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:50.651569 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:50.652776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:50.654569 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:50.657709 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:51.078392 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:51.079333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:51.091456 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:51.092801 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:51.095233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:51.104980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:51.228147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:51.239940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d84d2073-a749-46ec-9ae5-4af167e9f25a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1302 microversion: 2.1 time: 0.166252 Jul 29 04:47:51.240534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 34/59] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:51 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1302 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:51.262632 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:51.263344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:51.270207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:51.271226 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:51.272518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:51.273337 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:51.555496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:51.572015 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-23ce5f56-8495-4768-a2a5-f4270e11d5c4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.319433 Jul 29 04:47:51.576190 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 35/60] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:51 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:51.596020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:51.597134 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:51.610042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:51.610804 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:51.611868 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:51.613531 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:51.625656 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:51.638423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fad05f98-49d9-48af-8aff-73356638bd51 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 1.046776 Jul 29 04:47:51.639795 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 26/61] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:50 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:52.030149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:52.048633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-92d5d2b0-0fc3-4142-9bbb-f127fe3aa84b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.457006 Jul 29 04:47:52.059629 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 36/62] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:51 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:52.265467 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:52.266355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:52.278625 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.280433 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.283127 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.283790 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.512524 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-9f3301a4-1a7a-4ff9-95f2-d08e25ba38b3 req-48163e61-780d-4cae-a060-f0fe6f57baaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052579df-c255-4129-911a-8a4dda7e6ced", "tag": "aec72477-e53c-4111-8650-f834671263de"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:52.543639 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9f3301a4-1a7a-4ff9-95f2-d08e25ba38b3 req-48163e61-780d-4cae-a060-f0fe6f57baaa service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.547319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9f3301a4-1a7a-4ff9-95f2-d08e25ba38b3 req-48163e61-780d-4cae-a060-f0fe6f57baaa service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.569644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:52.605250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-9f3301a4-1a7a-4ff9-95f2-d08e25ba38b3 req-48163e61-780d-4cae-a060-f0fe6f57baaa service nova] Creating event network-changed:aec72477-e53c-4111-8650-f834671263de for instance 052579df-c255-4129-911a-8a4dda7e6ced on hv-cinder-85144 Jul 29 04:47:52.607055 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9f3301a4-1a7a-4ff9-95f2-d08e25ba38b3 req-48163e61-780d-4cae-a060-f0fe6f57baaa service nova] Acquired lock "compute-rpcapi-router" {{(pid=129684) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 04:47:52.610162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8f21ac00-0ea9-4562-9f8c-f5683866f354 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.612433 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8f21ac00-0ea9-4562-9f8c-f5683866f354 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.616326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8f21ac00-0ea9-4562-9f8c-f5683866f354 None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.617431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8f21ac00-0ea9-4562-9f8c-f5683866f354 None None] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.643134 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.compute.rpcapi [None req-8f21ac00-0ea9-4562-9f8c-f5683866f354 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 04:47:52.644319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8f21ac00-0ea9-4562-9f8c-f5683866f354 None None] Releasing lock "compute-rpcapi-router" {{(pid=129684) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 04:47:52.682006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8f21ac00-0ea9-4562-9f8c-f5683866f354 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174376 Jul 29 04:47:52.682723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 37/63] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:52.713964 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:52.715503 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:52.745113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:52.771063 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9fda8d01-17e8-43fa-b23a-71309d66cac9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1302 microversion: 2.1 time: 0.508740 Jul 29 04:47:52.775747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.778771 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.784910 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.785910 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.813772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 27/64] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:52 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1302 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:52.839234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:52.846062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:52.859488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.860507 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:52.865939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:52.866905 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:53.399384 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:53.404068 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:53.408587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-666de18b-7055-4ea0-939d-ca05d8080d24 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.724318 Jul 29 04:47:53.412784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 38/65] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:52 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:53.417230 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8d2f32ee-9230-4d57-a32b-c60ff4c41eb5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.601803 Jul 29 04:47:53.449681 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 28/66] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:52 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:53.464710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:53.469910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:53.489561 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:53.498470 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:53.502981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:53.504970 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:53.759653 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-4668380a-2ca3-442f-826b-bcb3061a4f5a req-d20eb679-5312-4054-9d52-25695650008d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c9906c-fdab-4215-a1c5-5cb82c3ab79e", "tag": "df448b29-2557-4bee-808a-385ffcca1ff4"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:53.797030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-4668380a-2ca3-442f-826b-bcb3061a4f5a req-d20eb679-5312-4054-9d52-25695650008d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:53.798118 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-4668380a-2ca3-442f-826b-bcb3061a4f5a req-d20eb679-5312-4054-9d52-25695650008d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:53.832181 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-4668380a-2ca3-442f-826b-bcb3061a4f5a req-d20eb679-5312-4054-9d52-25695650008d service nova] Creating event network-changed:df448b29-2557-4bee-808a-385ffcca1ff4 for instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e on hv-cinder-85144 Jul 29 04:47:53.854361 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-4668380a-2ca3-442f-826b-bcb3061a4f5a req-d20eb679-5312-4054-9d52-25695650008d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.440095 Jul 29 04:47:53.865570 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 39/67] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:47:53.873706 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:53.874754 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:53.882935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:53.883793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:53.884952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:53.886367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:54.174542 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:54.184499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f273f477-e495-4869-ab42-d6ce64444e09 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.733362 Jul 29 04:47:54.206291 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 29/68] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:53 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:54.315738 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:54.329556 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7ef715e6-db2c-4d92-84b6-63ac9122e761 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1300 microversion: 2.1 time: 0.462572 Jul 29 04:47:54.330141 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 40/69] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:53 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1300 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:54.449864 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:54.450698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:54.451793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:54.452461 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:54.470457 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:54.470906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:54.471864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:54.474372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:54.477108 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:54.477561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:54.477893 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:54.479373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:54.740647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:54.751016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-95eaa21a-1267-4730-bf56-6ad6f6c3a70d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.308701 Jul 29 04:47:54.752145 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 41/70] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:54 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:54.771378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:54.783918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-81c9ec02-6f3f-4a00-9676-6e0e9aa8092d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.349241 Jul 29 04:47:54.784400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 30/71] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:54 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:55.206431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:55.207155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:55.214874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.214874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.214874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.215485 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.352836 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:55.354110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:55.362723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.364063 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.369412 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.370898 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.397520 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:55.409622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-79b142b2-068e-41a9-9a4b-3e917f9633b5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.207058 Jul 29 04:47:55.410381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 42/72] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:55 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:55.450454 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:55.465753 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-258f1806-abfb-4464-95c5-2ec4a41c7643 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1300 microversion: 2.1 time: 0.116589 Jul 29 04:47:55.466776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 31/73] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:55 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:55.772767 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:55.773617 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:55.780105 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.780562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.781539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.782138 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.808918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:55.809794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:55.816152 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.816914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.817818 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.818263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.838902 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:55.924552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:55.934592 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7447bd65-315d-469d-b620-b8cdeaba09f2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.165844 Jul 29 04:47:55.935354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 43/74] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:55 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:55.954130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-248bae25-089f-4750-b5db-9b6329bb090b req-9b3c8a11-0491-4cab-ae8b-174079fccdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3508a994-61f6-4db5-83be-063a6eedc0cd", "tag": "70e45860-f254-40d2-808c-c68bdc1a745b"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:47:55.965052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-248bae25-089f-4750-b5db-9b6329bb090b req-9b3c8a11-0491-4cab-ae8b-174079fccdd3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:55.965506 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-248bae25-089f-4750-b5db-9b6329bb090b req-9b3c8a11-0491-4cab-ae8b-174079fccdd3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:55.979301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-248bae25-089f-4750-b5db-9b6329bb090b req-9b3c8a11-0491-4cab-ae8b-174079fccdd3 service nova] Creating event network-changed:70e45860-f254-40d2-808c-c68bdc1a745b for instance 3508a994-61f6-4db5-83be-063a6eedc0cd on hv-cinder-85144 Jul 29 04:47:55.984697 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-248bae25-089f-4750-b5db-9b6329bb090b req-9b3c8a11-0491-4cab-ae8b-174079fccdd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034198 Jul 29 04:47:55.985307 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 44/75] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:47:56.027146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:56.037017 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bbce4b74-6495-4136-bb35-879a71744f16 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.231621 Jul 29 04:47:56.048624 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 32/76] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:55 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:56.432235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:56.432976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:56.442908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:56.443365 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:56.444157 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:56.444708 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:56.487835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:56.490894 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:56.498931 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:56.500052 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:56.501364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:56.502020 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:56.615713 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:56.623391 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:56.633535 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9600b468-52b8-4353-9644-a62671620b64 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.205868 Jul 29 04:47:56.637143 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c1aa9355-d728-47f3-83b9-d1d9f08603f5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1300 microversion: 2.1 time: 0.152292 Jul 29 04:47:56.643882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 33/77] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:56 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:56.645740 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 45/78] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:56 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:56.958667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:56.959639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:56.966204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:56.966754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:56.967613 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:56.968149 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:57.059882 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:57.060559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:57.068055 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:57.068268 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:57.069259 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:57.069704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:57.235198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:57.244479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-039e0cf7-ca49-4f64-b512-518a2de0780c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.291088 Jul 29 04:47:57.245610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 34/79] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:56 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:57.321587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:57.330702 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5ede7052-e1dd-4f01-8d07-1bdf0e298eb9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.275206 Jul 29 04:47:57.344645 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 46/80] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:57 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:57.675110 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:57.675742 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:57.679933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:57.680548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:57.682954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:57.683396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:57.683519 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:57.684243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:57.684878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:57.688978 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:57.689430 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:57.690196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:57.690631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:57.775418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:57.783091 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0f68069d-441e-428a-8e39-b90e3cb3e51d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1300 microversion: 2.1 time: 0.124014 Jul 29 04:47:57.783704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 47/81] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:57 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:57.833404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:57.840981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6b99a39f-299c-4c57-a945-ac6f60ef3b20 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.189507 Jul 29 04:47:57.841555 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 35/82] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:57 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:58.279007 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:58.279549 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:58.287389 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.287766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.288527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.289029 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.353822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:58.354442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:58.360799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.361257 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.362788 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.363940 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.499167 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:58.513606 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3be227a3-b9f6-4b86-98a0-a4d021290844 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.238774 Jul 29 04:47:58.514690 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 48/83] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:58 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:58.545393 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:58.554083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-162928de-871b-4621-a0ae-49bc8ae979df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.204223 Jul 29 04:47:58.554666 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 36/84] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:58 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:58.806180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:58.807469 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:58.813809 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.814270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.815054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.815517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.862814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:58.864014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:58.873504 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.876229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.877972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:58.880259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:58.887872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:58.895482 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7331d26d-64c3-43f2-8953-e57130656161 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1300 microversion: 2.1 time: 0.093319 Jul 29 04:47:58.896260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 49/85] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:58 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:59.030007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:59.037493 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-956c3ee3-b5cf-4a20-a1d7-3f92f0aba65f tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.178406 Jul 29 04:47:59.038058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 37/86] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:58 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:59.537419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:59.538183 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:59.541490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:47:59.545854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:59.546836 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:59.547862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:59.548378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:59.578158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:59.579111 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:59.589044 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:59.590304 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:59.591510 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:59.592276 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:59.705627 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:59.715192 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-16d102cc-4673-42eb-a40d-01f4a5de97ce tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.183454 Jul 29 04:47:59.716467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 50/87] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:59 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:47:59.755249 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:47:59.763650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-332aa7fa-1acb-4b32-82e2-dfc45a0421cb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.191269 Jul 29 04:47:59.764615 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 38/88] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:59 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:47:59.917285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:47:59.917901 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:47:59.924258 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:59.924921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:59.925938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:47:59.926468 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:47:59.993025 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:00.001768 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-afc068cd-7746-4454-98fa-881cda0bb401 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1300 microversion: 2.1 time: 0.088427 Jul 29 04:48:00.002529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 51/89] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:47:59 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:00.058358 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:00.059495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:00.065414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:00.066067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:00.067520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:00.067985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:00.215089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:00.223820 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5940dd93-6582-4d53-bad6-d223c9575a0a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.169309 Jul 29 04:48:00.224406 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 39/90] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:00 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:00.737820 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:00.738478 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:00.745244 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:00.745705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:00.746561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:00.746916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:00.790312 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:00.790956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:00.792813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=4 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:00.800045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:00.800338 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:00.802194 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:00.802519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:01.230454 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:01.238329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9d661c19-da5a-4c01-80ad-9803de444ae7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.451943 Jul 29 04:48:01.239425 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 40/91] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:00 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:01.244478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:01.245300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:01.252168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:01.252631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:01.253400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:01.254067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:01.332896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:01.344585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8aa62f89-5ab3-4b98-b369-a4d2560253c7 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.610664 Jul 29 04:48:01.358684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 52/92] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:00 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:01.373612 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:01.374452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:01.383561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:01.387305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:01.388453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:01.390213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:01.454367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:01.475453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-59d6cc74-1571-435a-b5a7-e8287741489c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1300 microversion: 2.1 time: 0.234755 Jul 29 04:48:01.476578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 41/93] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:01 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1300 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:01.912825 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:01.921374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-741f805b-0993-4952-86ea-ec4d9587cf3e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.559861 Jul 29 04:48:01.921963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 53/94] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:01 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:02.272642 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:02.274497 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:02.288954 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.289423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.291768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.294267 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.374228 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:02.375451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:02.385692 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.386930 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.387922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.390218 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.573420 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:02.585629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7677c913-f1cb-476d-afb2-629b4088aa02 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.318926 Jul 29 04:48:02.594651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 42/95] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:02 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:02.619407 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:02.619937 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:02.633510 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.633970 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.638546 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.639210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.641400 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:02.672090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:02.683666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-73b0e455-d150-4fe4-b495-64031c026304 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.313986 Jul 29 04:48:02.685008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 54/96] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:02 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:02.823653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:02.838459 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-89942acc-a604-42b4-a2da-7e5c0150c100 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.241332 Jul 29 04:48:02.839112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 43/97] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:02 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:02.943199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:02.943883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:02.949906 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.950390 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.951173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:02.951643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:02.970734 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:03.085082 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:03.093072 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f66dbdcb-5626-4058-b8ef-0239ec6b8758 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.154576 Jul 29 04:48:03.093744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 55/98] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:02 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:03.607327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:03.607926 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:03.618420 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:03.619638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:03.620439 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:03.620924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:03.708086 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:03.709544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:03.721604 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:03.722056 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:03.724181 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:03.724677 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:03.764661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:03.773433 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6a06a7f5-1db7-4657-8790-5e91f563097b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.169857 Jul 29 04:48:03.774014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 44/99] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:03 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:03.859798 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:03.862273 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:03.863835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:03.868032 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ddec0a96-2733-4f6b-a72c-a3097b8829bc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.165378 Jul 29 04:48:03.868637 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 56/100] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:03 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:03.870659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:03.871185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:03.872031 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:03.872616 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:04.010806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:04.018458 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fd2b5456-9a5c-4168-8a78-024a59016ae7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.161447 Jul 29 04:48:04.019058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 45/101] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:03 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:04.113357 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:04.114101 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:04.120073 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:04.120518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:04.121538 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:04.121980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:04.250301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:04.257951 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a21fad28-3eb2-4e5d-aa9b-c01aa083c1dc tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.148679 Jul 29 04:48:04.258523 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 57/102] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:04 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:04.794760 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:04.795375 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:04.803216 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:04.803777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:04.804631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:04.805103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:04.889382 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:04.890154 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:04.897692 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:04.898216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:04.899050 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:04.899487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:04.953516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:04.961507 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d0ea525e-8f46-43f8-a205-4075928aaaec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.170419 Jul 29 04:48:04.962289 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 46/103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:04 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:05.039201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:05.039824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:05.045850 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:05.046771 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:05.047714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:05.048186 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:05.073356 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:05.081535 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4b52c3fc-6cc5-487f-a9b7-2daeb8a9bfea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.196180 Jul 29 04:48:05.082361 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 58/104] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:04 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:05.184064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:05.192479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fef885a6-891b-4f3a-8809-0f2536df3b69 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.157329 Jul 29 04:48:05.193160 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 47/105] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:05 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:05.279374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:05.280063 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:05.287317 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:05.287713 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:05.288497 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:05.288963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:05.429228 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:05.437204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-23033c43-6e1c-4eef-b5e8-83e55190303e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.161786 Jul 29 04:48:05.437770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 59/106] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:05 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:05.986739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:05.987408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:05.994917 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:05.995377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:05.996144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:05.996805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:06.107843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:06.108578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:06.116204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:06.116842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:06.117745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:06.118413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:06.140834 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:06.149100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d6c9d51f-7d81-4731-b4c2-e169b98f73f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.166024 Jul 29 04:48:06.149655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 48/107] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:05 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:06.213480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:06.214249 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:06.220376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:06.220930 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:06.221964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:06.222630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:06.227171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:06.295143 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:06.304274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bccbba40-230e-4bf3-965c-63c474e2c7b9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.202500 Jul 29 04:48:06.305016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 60/108] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:06 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:06.368475 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:06.376124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-dc2caabc-cdd8-4b06-815a-40a7c68f5cb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.166424 Jul 29 04:48:06.376695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 49/109] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:06 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:06.458969 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:06.459581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:06.465716 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:06.466165 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:06.466939 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:06.467377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:06.611507 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:06.620073 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f3075236-f4ec-484f-a4d9-040066e250d4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.165977 Jul 29 04:48:06.620689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 61/110] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:06 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:07.170649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:07.171518 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:07.177672 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.178124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.178895 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.179337 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.325776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:07.327166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:07.334212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:07.335852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.336555 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.337710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.338430 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.346582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e0b46ca7-0d35-4eef-af07-e507077ceb5a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.179667 Jul 29 04:48:07.347778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 50/111] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:07 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:07.397882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:07.398910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:07.405951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.407005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.408699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.409420 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.503375 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:07.513878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bd65a865-5306-4fb5-99a6-6979feeed287 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.191931 Jul 29 04:48:07.514709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 62/112] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:07 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:07.585077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:07.593556 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-622759a3-0892-44a0-96f5-dedb44564153 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.200042 Jul 29 04:48:07.594132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 51/113] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:07 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:07.644169 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:07.645095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:07.651292 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.651743 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.652515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:07.653647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:07.843928 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:07.853539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1f4d4a80-ba08-4b94-8e5d-3adcf9293f37 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.213818 Jul 29 04:48:07.854285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 63/114] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:07 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:08.367937 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:08.369195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:08.375989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.376800 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.377777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.378426 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.539659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:08.545183 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:08.547755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:08.555494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.556351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.556749 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f739b6a4-d331-4ecd-a407-24dbfbb58786 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.191467 Jul 29 04:48:08.557364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 52/115] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:08 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:08.557798 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.558576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.617663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:08.620175 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:08.632119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.637258 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.639007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.639609 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.852444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:08.862301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ba671b4a-0a9b-4fef-ac01-8d4215deedfc tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.330072 Jul 29 04:48:08.864158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 64/116] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:08 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:08.881446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:08.882328 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:08.885950 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:08.889765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.890538 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.891592 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:08.892179 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:08.895924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b1eb162e-5761-4b16-bf30-a75de80c204f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.284513 Jul 29 04:48:08.911154 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 53/117] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:08 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:09.059703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:09.068476 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7f6773e9-f60f-477a-9743-32859c6c8650 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.196206 Jul 29 04:48:09.069579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 65/118] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:08 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:09.582592 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:09.583312 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:09.590074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:09.590686 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:09.591527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:09.592038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:09.751824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:09.762755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8440b1be-d6a9-4055-b8c4-6fdbbc49874e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.185273 Jul 29 04:48:09.763341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 54/119] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:09 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:09.885861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:09.886468 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:09.892961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:09.893678 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:09.895745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:09.896401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:09.918890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:09.919812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:09.931982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:09.932428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:09.933221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:09.933655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:10.116512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:10.131309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e70be47c-2722-46bf-aa3f-8b8e02783af0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.249662 Jul 29 04:48:10.142454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 66/120] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:09 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:10.157401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:10.158552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:10.171219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:10.174037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:10.175020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:10.177040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:10.178248 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:10.192889 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fb44ae44-c5b3-4899-9e82-3c4b018ff2ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.278402 Jul 29 04:48:10.205364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 55/121] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:09 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:10.332970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:10.342451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f859d747-7033-4089-9010-53af04bc6a2e tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.192178 Jul 29 04:48:10.343327 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 67/122] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:10 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:10.785538 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:10.787217 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:10.794118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:10.794832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:10.796073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:10.796748 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:10.963053 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:10.970418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2c32690a-ffad-40de-9dc2-c241dcac8532 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.189918 Jul 29 04:48:10.970977 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 56/123] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:10 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:11.153870 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:11.154484 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:11.162385 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:11.163069 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:11.164038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:11.164694 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:11.217172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:11.218100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:11.230091 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:11.230636 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:11.231439 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:11.231895 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:11.358742 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:11.372471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3acfe4f5-210f-4d5c-b480-a72cc560e697 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.222221 Jul 29 04:48:11.385537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 68/124] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:11 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:11.394596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:11.395111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:11.401553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:11.402010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:11.402926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:11.403376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:11.455760 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:11.465203 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-264368d7-a7ab-4676-91ad-d1bc1bb2bcc8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.253340 Jul 29 04:48:11.465793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 57/125] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:11 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:11.546820 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:11.555374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4d97c368-2e7d-4105-aad5-225b87cae1cd tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.167271 Jul 29 04:48:11.556067 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 69/126] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:11 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:11.996214 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:11.998088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:12.031106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.031558 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.032508 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.033137 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.399747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:12.400512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:12.411980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.415896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.420689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.421671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.431264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:12.441791 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d962de35-dd7f-4f45-a789-46e7d9a24d7e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.451255 Jul 29 04:48:12.442752 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 58/127] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:11 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:12.491972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:12.492944 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:12.509570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.511228 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.518034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.521325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.709439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:12.725367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cea64c29-db00-470b-9d26-e91c7ae1c43c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.329797 Jul 29 04:48:12.736026 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 70/128] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:12 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:12.750019 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:12.750919 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:12.768827 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.770098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.771275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:12.771900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:12.872898 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:12.883784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1ea38529-f7c6-4f1d-81d3-10534cc72a17 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.399425 Jul 29 04:48:12.885848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 59/129] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:12 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:13.020213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-e7df1b1b-fa38-4410-830e-b5cba8ff9408 req-c65503e7-efac-429e-a9af-68bda08f2e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5786f4ef-cc00-4e18-9910-7ba1707d903c", "name": "network-vif-plugged", "status": "completed", "tag": "9311cd5a-7a75-4479-a351-988245db7504"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:13.036784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-e7df1b1b-fa38-4410-830e-b5cba8ff9408 req-c65503e7-efac-429e-a9af-68bda08f2e70 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.037501 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-e7df1b1b-fa38-4410-830e-b5cba8ff9408 req-c65503e7-efac-429e-a9af-68bda08f2e70 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:13.057498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-e7df1b1b-fa38-4410-830e-b5cba8ff9408 req-c65503e7-efac-429e-a9af-68bda08f2e70 service nova] Creating event network-vif-plugged:9311cd5a-7a75-4479-a351-988245db7504 for instance 5786f4ef-cc00-4e18-9910-7ba1707d903c on hv-cinder-85144 Jul 29 04:48:13.064923 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-e7df1b1b-fa38-4410-830e-b5cba8ff9408 req-c65503e7-efac-429e-a9af-68bda08f2e70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177213 Jul 29 04:48:13.066673 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 60/130] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:13.103985 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:13.117052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-420dc574-eee2-4991-a8ac-9cf0e247c4f6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.373249 Jul 29 04:48:13.120797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 71/131] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:12 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:13.263814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-c79d62b7-743c-4f4a-8d42-8df28f7f8d4e req-fa776665-c5f5-40cb-ac87-f193ad5df92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d225e6-c457-47da-bb55-5620ad7f15e7", "tag": "a62fbd73-0c26-4732-9cf9-7667cea10de3"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:13.280909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-c79d62b7-743c-4f4a-8d42-8df28f7f8d4e req-fa776665-c5f5-40cb-ac87-f193ad5df92c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.281548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-c79d62b7-743c-4f4a-8d42-8df28f7f8d4e req-fa776665-c5f5-40cb-ac87-f193ad5df92c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:13.293515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-c79d62b7-743c-4f4a-8d42-8df28f7f8d4e req-fa776665-c5f5-40cb-ac87-f193ad5df92c service nova] Creating event network-changed:a62fbd73-0c26-4732-9cf9-7667cea10de3 for instance 94d225e6-c457-47da-bb55-5620ad7f15e7 on hv-cinder-85144 Jul 29 04:48:13.298647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-c79d62b7-743c-4f4a-8d42-8df28f7f8d4e req-fa776665-c5f5-40cb-ac87-f193ad5df92c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039123 Jul 29 04:48:13.299347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 61/132] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:13.468482 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:13.469272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:13.475644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.476098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:13.476932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.477373 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:13.481610 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:13.613869 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:13.622111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f6e4a050-7cb7-4da2-bfd4-180a8d1678b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.157578 Jul 29 04:48:13.622714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 72/133] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:13 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:13.754340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:13.755123 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:13.761938 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.762441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:13.763442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.764050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:13.908062 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:13.909049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:13.921709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.922170 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:13.929468 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:13.929927 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:14.194868 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:14.209309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2b67ec2d-357e-4a39-8ac0-0bb790611f84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.306438 Jul 29 04:48:14.225621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 73/134] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:13 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:14.234253 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:14.236857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:14.244420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:14.245211 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:14.247697 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:14.248478 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:14.503567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:14.511425 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b41e8e51-dbf3-4b20-aad5-644379a11403 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.765538 Jul 29 04:48:14.512007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 62/135] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:13 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:14.512299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:14.522920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fff7cfc2-ee8e-4d64-ba1e-5677ff30cf25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.295590 Jul 29 04:48:14.523714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 74/136] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:14 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:14.643353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:14.645573 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:14.653170 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:14.653976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:14.654988 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:14.655706 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:15.150280 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:15.160124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9119bdb5-5c6f-4d3b-83ed-83068e67d284 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.520618 Jul 29 04:48:15.161533 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 63/137] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:14 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:15.231593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:15.232216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:15.242174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:15.242982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:15.244439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:15.245080 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:15.534018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:15.535371 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:15.547506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:15.548781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:15.551812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:15.553400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:15.829131 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:15.846718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c991a169-abd5-4838-b458-336cdd2c6b15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.618780 Jul 29 04:48:15.861538 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 75/138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:15 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:15.866362 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:15.866822 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:15.881582 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:15.882060 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:15.882861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:15.883422 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:15.931815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:15.949227 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6c71f3a0-4306-4a64-b860-93bb2790226d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.419570 Jul 29 04:48:15.953486 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 64/139] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:15 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:16.183903 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:16.186005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:16.200631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:16.201329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:16.205077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:16.206777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:16.332074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:16.340593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a5583d1e-f017-4200-be3c-2a3e2da407c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.484552 Jul 29 04:48:16.341289 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 76/140] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:15 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:16.499732 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:16.508770 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d5bcb439-9f9c-4029-a244-35fd4cc8a12c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.330207 Jul 29 04:48:16.509355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 65/141] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:16 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:16.638760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-11a7866a-6f19-4b7b-b285-2cdecce7960e req-1883246e-705b-479e-8605-40eb5a969b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052579df-c255-4129-911a-8a4dda7e6ced", "name": "network-vif-plugged", "status": "completed", "tag": "aec72477-e53c-4111-8650-f834671263de"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:16.670649 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-11a7866a-6f19-4b7b-b285-2cdecce7960e req-1883246e-705b-479e-8605-40eb5a969b2a service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:16.671378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-11a7866a-6f19-4b7b-b285-2cdecce7960e req-1883246e-705b-479e-8605-40eb5a969b2a service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:16.702514 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-11a7866a-6f19-4b7b-b285-2cdecce7960e req-1883246e-705b-479e-8605-40eb5a969b2a service nova] Creating event network-vif-plugged:aec72477-e53c-4111-8650-f834671263de for instance 052579df-c255-4129-911a-8a4dda7e6ced on hv-cinder-85144 Jul 29 04:48:16.713358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-11a7866a-6f19-4b7b-b285-2cdecce7960e req-1883246e-705b-479e-8605-40eb5a969b2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078238 Jul 29 04:48:16.716903 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 77/142] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:16.869032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:16.870347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:16.876754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:16.877455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:16.878551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:16.879213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:16.972594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:16.973253 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:16.980382 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:16.981206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:16.982292 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:16.983008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:17.075380 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:17.101341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-884328cf-7508-4683-843e-010ca89cce4e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.236024 Jul 29 04:48:17.114640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 66/143] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:16 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:17.225681 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:17.235317 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1e1d384e-168a-4b3d-8d8d-88466d4d31a8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.266947 Jul 29 04:48:17.235918 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 78/144] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:16 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:17.363906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:17.364847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:17.373287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:17.374243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:17.375047 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:17.375496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:17.395796 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:17.534021 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:17.535355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:17.548048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:17.549686 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:17.551967 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:17.552542 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:17.621341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:17.631764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9e39c1b5-4cde-4ef8-be96-7de62bea8203 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.273158 Jul 29 04:48:17.632961 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 67/145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:17 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:17.802854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:17.812503 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-41f2bf8f-cc15-4d03-81cf-e7c8ccb2f714 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.280548 Jul 29 04:48:17.813775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 79/146] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:17 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:18.122311 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:18.122752 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:18.124578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=91 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:18.134014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.134440 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.135434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.135878 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.261534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:18.263738 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:18.271011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.272204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.273840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.274467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.290907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:18.299547 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-90cdd3fa-f52d-48cb-a7a4-195b0fe72759 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.181168 Jul 29 04:48:18.300699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 68/147] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:18 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:18.434773 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:18.443381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-631b3c4f-ac01-4654-91dd-a6a86ebe69d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.187572 Jul 29 04:48:18.444056 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 80/148] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:18 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:18.655595 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:18.656949 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:18.676874 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.677360 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.678100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.678539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.835699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:18.837275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:18.844797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.845625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.846534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:18.848142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:18.946869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:18.965290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d6f63b1e-5985-4fd2-9b8d-123d408f7789 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.313861 Jul 29 04:48:18.985834 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 69/149] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:18 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:19.015567 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:19.024984 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e00c81fe-23e0-4c40-976b-ac19c97a65ab tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.193940 Jul 29 04:48:19.025486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 81/150] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:18 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:19.323091 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:19.325291 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:19.332298 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:19.333055 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:19.334075 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:19.334852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:19.465123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:19.465793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:19.472716 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:19.473160 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:19.473947 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:19.474420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:19.485773 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:19.493933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4c17737e-f699-4780-b725-6d48d9f0202f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.174695 Jul 29 04:48:19.494690 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 70/151] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:19 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:19.610189 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:19.618158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-15e50e77-73b0-42e4-b0cc-f6e8ebbf04a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.157110 Jul 29 04:48:19.618887 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 82/152] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:19 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:19.987114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:19.987788 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:19.993979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:19.994464 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:19.995247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:19.995675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:20.046922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:20.047584 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:20.053879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:20.054333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:20.055096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:20.055533 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:20.123737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:20.132173 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-904dd3f4-c6d1-4280-87da-59a982bdeee7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.148831 Jul 29 04:48:20.132798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 71/153] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:19 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:20.186021 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:20.194128 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fb120703-7f55-4bd8-a7af-81a8177b1cf3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.151340 Jul 29 04:48:20.194685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 83/154] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:20 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:20.515305 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:20.515920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:20.522365 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:20.522812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:20.523567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:20.524002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:20.639877 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:20.640663 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:20.647925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:20.648647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:20.649595 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:20.650038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:20.667196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:20.675747 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-eae4cd5b-a279-4d3b-802e-0d6bc5051b28 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.163578 Jul 29 04:48:20.676801 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 72/155] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:20 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:20.797187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:20.804970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-65fad672-a383-4a83-95b3-59200b1cb96b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.169175 Jul 29 04:48:20.805575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 84/156] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:20 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:21.154733 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:21.155563 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:21.165697 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.166450 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.167710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.168586 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.216376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:21.217220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:21.223891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.224483 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.225521 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.226035 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.329541 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:21.343714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ccd905c2-c8de-4d7b-98d5-9fa1cc279764 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.193778 Jul 29 04:48:21.344299 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 73/157] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:21 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:21.382821 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:21.390185 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-80e41772-4bf0-4b44-9594-abee6f1949a3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.178363 Jul 29 04:48:21.390751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 85/158] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:21 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:21.697020 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:21.697628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:21.703596 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.704037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.704816 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.705247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.827972 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:21.829462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:21.842667 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.843113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.843880 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:21.844310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:21.854737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:21.862779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e9de2e4f-9d26-4734-af8b-d1763f56b537 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.169017 Jul 29 04:48:21.863788 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 74/159] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:21 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:21.977651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:21.984925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-97f0b61a-b8d4-4bb5-b164-2bd4a6902eae tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.162831 Jul 29 04:48:21.987044 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 86/160] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:21 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:22.367904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:22.368631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:22.378329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:22.379639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:22.381377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:22.382560 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:22.412299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:22.413531 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:22.421012 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:22.421466 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:22.422234 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:22.433063 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:22.588955 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:22.606602 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-27720d38-229c-4745-8b58-82d6669f6597 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.198941 Jul 29 04:48:22.608091 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 87/161] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:22 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:22.613875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-b2e7de9b-9991-4b7e-9186-f13b9c01988a req-8aed40ef-0023-491a-bc9a-a817e1bcc121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c9906c-fdab-4215-a1c5-5cb82c3ab79e", "name": "network-vif-plugged", "status": "completed", "tag": "df448b29-2557-4bee-808a-385ffcca1ff4"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:22.619953 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:22.624878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b2e7de9b-9991-4b7e-9186-f13b9c01988a req-8aed40ef-0023-491a-bc9a-a817e1bcc121 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:22.625823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b2e7de9b-9991-4b7e-9186-f13b9c01988a req-8aed40ef-0023-491a-bc9a-a817e1bcc121 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:22.632671 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5faab1dd-cc13-4da3-ac45-f7be7da9a4ad tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.267955 Jul 29 04:48:22.634636 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 75/162] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:22 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:22.638690 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-b2e7de9b-9991-4b7e-9186-f13b9c01988a req-8aed40ef-0023-491a-bc9a-a817e1bcc121 service nova] Creating event network-vif-plugged:df448b29-2557-4bee-808a-385ffcca1ff4 for instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e on hv-cinder-85144 Jul 29 04:48:22.646348 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-b2e7de9b-9991-4b7e-9186-f13b9c01988a req-8aed40ef-0023-491a-bc9a-a817e1bcc121 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036577 Jul 29 04:48:22.648043 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 88/163] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:22.884562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:22.885527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:22.892007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:22.892574 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:22.893530 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:22.895021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:22.962480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1456268359", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "networks": [{"uuid": "48d67382-c2d3-47d5-b28b-aeebd485858a"}]}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:23.019371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] validate_networks() for [('48d67382-c2d3-47d5-b28b-aeebd485858a', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:48:23.059145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:23.067288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8b1e796e-3893-48eb-a516-fbb3b4e3a453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.187238 Jul 29 04:48:23.067852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 76/164] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:22 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:23.072226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:23.072856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:23.079338 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.080016 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.081014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.081970 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.218243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:23.225401 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b61faf8b-cd45-4145-b1fe-d670611c6231 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.156576 Jul 29 04:48:23.226152 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 77/165] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:23 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:23.386082 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:48:23.386509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:48:23.386983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:48:23.387394 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:48:23.387806 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:48:23.397087 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.397535 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.398334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.398770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.415282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Getting quotas for project e52663d55be44e12b4aa939974e8e517. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:48:23.419193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Getting quotas for user 87f97b8b406e442b93cbdda090d7e9ff and project e52663d55be44e12b4aa939974e8e517. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:48:23.430909 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:48:23.433250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:48:23.477293 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9cb98c64-b3f1-4abc-b7a8-fff0a22ab5ac tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521948 Jul 29 04:48:23.477951 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 89/166] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:48:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:48:23.489175 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-098c3011-9fb6-4c91-b177-07ff810e9e25 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:23.489838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-098c3011-9fb6-4c91-b177-07ff810e9e25 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:23.541181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-098c3011-9fb6-4c91-b177-07ff810e9e25 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:23.548161 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-098c3011-9fb6-4c91-b177-07ff810e9e25 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1214 microversion: 2.1 time: 0.063373 Jul 29 04:48:23.548938 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 78/167] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:23 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:23.627119 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:23.627908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:23.634556 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.635104 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.635954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.636400 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.657847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:23.658593 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:23.667018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.667821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.669453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:23.670334 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:23.794156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:23.804578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:23.820988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-459b23cd-60b9-43f8-b0cd-9758029e0271 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.197576 Jul 29 04:48:23.822210 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 90/168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:23 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:23.855937 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:23.866515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e3e0b6f5-8784-4769-b3ee-6e6a25b799bf tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.212487 Jul 29 04:48:23.867440 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 79/169] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:23 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:24.087696 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:24.088324 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:24.094380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.094834 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.095593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.096037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.221281 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:24.229338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7710b5bf-3dd7-453a-87de-549931b96db8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.145513 Jul 29 04:48:24.229910 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 91/170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:24 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:24.246551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:24.247175 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:24.253309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.253904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.254722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.255150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.383118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:24.391159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b689a912-d68c-4526-9a8e-892adbdd5512 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.148369 Jul 29 04:48:24.391748 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 80/171] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:24 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:24.570432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:24.570954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:24.576963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.577414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.578174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.578611 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.636914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:24.645115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f88a834f-9efd-4d2a-847d-e449ae017a59 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.078735 Jul 29 04:48:24.645685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 92/172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:24 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:24.842316 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:24.842852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:24.848931 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.849378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.850131 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.850565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.887100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:24.887700 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:24.890571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:24.895842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.896331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.897184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:24.897710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:24.991730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:25.009132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-39c2ecc2-cd92-41a8-a2f0-070a604078df tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.170566 Jul 29 04:48:25.009720 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 81/173] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:24 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:25.032788 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:25.040224 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-efa0ff8a-6a30-45a4-9e78-9c7a66804aa5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.156875 Jul 29 04:48:25.040825 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 93/174] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:24 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:25.251355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:25.251972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:25.258188 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:25.258640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:25.259475 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:25.259920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:25.391490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:25.399994 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8217625c-32e3-449e-973b-ca6e88f8db29 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.152651 Jul 29 04:48:25.400577 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 82/175] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:25 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:25.417324 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:25.417946 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:25.424358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:25.425664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:25.426431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:25.426993 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:25.562770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:25.570313 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fabd19fc-521b-4319-8526-e3d1521c3f87 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.157489 Jul 29 04:48:25.570879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 94/176] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:25 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:25.666210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:25.666818 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:25.673163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:25.673615 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:25.674374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:25.674953 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:25.732868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:25.740363 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d018aade-7c97-494a-b9a5-4d1c9974247e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.078023 Jul 29 04:48:25.740967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 83/177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:25 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:26.029792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:26.030397 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:26.036522 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.037009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.037769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.038201 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.061869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:26.062484 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:26.069152 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.069615 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.070393 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.070836 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.170155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:26.179149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a7fde583-6de2-4f7a-9bad-6784884eed48 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.153058 Jul 29 04:48:26.179863 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 95/178] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:26 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:26.210183 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:26.213658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:26.218522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e53c3ae2-27f8-4ed6-b532-51575e5c2b8a tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.160442 Jul 29 04:48:26.219460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 84/179] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:26 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:26.423455 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:26.424074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:26.430893 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.431346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.432117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.432566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.559900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:26.567901 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-83a0b63a-ab70-4eae-9a39-282f9b0d2eec tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.148533 Jul 29 04:48:26.568473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 96/180] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:26 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:26.591309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:26.591914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:26.598773 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.599223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.599986 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.600423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.727032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:26.734374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-63de7ad0-16c3-4468-a99e-dbc712f9da6d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.147073 Jul 29 04:48:26.734968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 85/181] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:26 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:26.761443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:26.761981 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:26.768078 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.768560 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.769351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:26.769791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:26.829076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:26.836685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b0b1a9c0-dc59-4754-a1e5-fbd789337d7e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.079401 Jul 29 04:48:26.837255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 97/182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:26 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:27.200767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:27.201376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:27.208265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.208740 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.209609 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.210186 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.239760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:27.240367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:27.246804 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.247249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.248013 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.248446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.364064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:27.376623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8d61342b-477d-4757-8a13-1d3736e80dc8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.179631 Jul 29 04:48:27.377496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 86/183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:27 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:27.420270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:27.428855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c984c8a3-afc8-4eb2-9231-2fa2b3368227 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.193060 Jul 29 04:48:27.429471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 98/184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:27 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:27.589284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:27.589818 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:27.595853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.597040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.597781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.598595 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.730583 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:27.738992 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b4d1d74a-b2d7-4411-a36c-fa7c89cc4437 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.153729 Jul 29 04:48:27.739559 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 87/185] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:27 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:27.755306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:27.755925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:27.762186 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.762630 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.763380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.763812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.857126 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:27.857905 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:27.864476 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.864966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.865738 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:27.866175 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:27.890785 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:27.899071 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-620596e5-738f-453a-b0f1-f3714118b988 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.147666 Jul 29 04:48:27.899647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 99/186] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:27 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:27.927134 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:27.934667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-135b9197-c254-420a-a757-75a451dcef10 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.081343 Jul 29 04:48:27.935233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 88/187] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:27 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:28.400114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:28.400765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:28.410114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.410752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.412065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.413689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.450943 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:28.451900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:28.458824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.459485 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.460791 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.461471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.613061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:28.625759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5b56e344-4500-4cd2-b8c6-c6a7217e6d8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.228851 Jul 29 04:48:28.629097 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 100/188] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:28 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:28.642182 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:28.651320 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e225b71b-89b3-43f5-9f9f-10a859386c5d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.203996 Jul 29 04:48:28.651899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 89/189] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:28 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:28.760722 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:28.761526 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:28.772042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.772624 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.773464 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.773969 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.909841 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:28.918929 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d8351ccf-31f9-4895-b7af-ad097d64e8ef tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.162942 Jul 29 04:48:28.919955 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 101/190] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:28 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:28.933516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:28.933516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:28.933516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.933516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.934083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.934083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.955736 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:28.957839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:28.964244 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.964819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:28.965660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:28.966171 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:29.032270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:29.050415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-037ba375-99b7-4dfb-8fe7-07022645f376 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.098572 Jul 29 04:48:29.051313 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 102/191] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:28 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:29.197734 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:29.206371 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f5643f9a-c5d7-4c18-94e5-62a59b8c899d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.288602 Jul 29 04:48:29.206949 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 90/192] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:28 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:29.654505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:29.655727 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:29.668421 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:29.668894 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:29.669839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:29.670896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:29.675063 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:29.676286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:29.682353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:29.682808 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:29.683580 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:29.684024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:29.850766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:29.859568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bb6c9f13-a675-4c94-97c2-4dc904538702 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.214664 Jul 29 04:48:29.860758 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 103/193] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:29 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:29.876797 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:29.895788 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-997e7e53-8a64-4f98-9442-89ae46853f47 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.223889 Jul 29 04:48:29.897184 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 91/194] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:29 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:29.940976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:29.941824 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:29.949603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:29.950260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:29.951256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:29.951923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.073870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:30.074561 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:30.082099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.082631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.083473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.084172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.154775 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:30.165577 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b2d19997-f1e9-4867-9aa6-1dbb5148f8d2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.095501 Jul 29 04:48:30.180851 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 92/195] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:30 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:30.202438 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:30.210800 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5f3951cb-b2de-4784-93be-3c06026d655c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.273875 Jul 29 04:48:30.211636 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 104/196] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:29 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:30.231488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:30.232864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:30.240327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.240947 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.242220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.242662 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.431116 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:30.438631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0def9d12-6de1-4209-bf3f-bee932225da0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.213807 Jul 29 04:48:30.439199 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 93/197] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:30 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:30.881762 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:30.882382 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:30.888494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.889059 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.889836 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.890302 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.919890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:30.921805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:30.933017 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.933682 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:30.934923 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:30.935376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:31.051002 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:31.063164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a024deeb-36a7-43dc-8cb8-3c1660fc891b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.185117 Jul 29 04:48:31.063860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 105/198] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:30 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:31.098874 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:31.106765 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3517f096-9890-4614-9265-30dd93b571fe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.192497 Jul 29 04:48:31.107339 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 94/199] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:30 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:31.187367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:31.188386 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:31.195466 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:31.196026 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:31.196901 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:31.197403 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:31.234759 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:31.235492 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:31.244144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:31.244782 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:31.245798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:31.246506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:31.264258 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:31.273875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a72ba67a-8570-4c66-878c-756748a676d6 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.090782 Jul 29 04:48:31.285600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 106/200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:31 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:31.404621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:31.413088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8adb42cf-1632-4291-aa14-d3764f9916aa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.183454 Jul 29 04:48:31.413767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 95/201] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:31 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:31.459967 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:31.460585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:31.466930 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:31.467380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:31.468299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:31.468946 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:31.490621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:31.650232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:31.670851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cfe199cd-af4f-4f8c-8dc5-aaae70d72f1d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.214900 Jul 29 04:48:31.677981 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 107/202] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:31 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:32.085643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:32.086223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:32.092316 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.092918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.093559 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.093991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.130065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:32.131396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:32.138198 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.139040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.140745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.141342 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.275027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:32.283243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6a931187-d63d-446f-bb79-796c71e34b1d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.202482 Jul 29 04:48:32.284226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 96/203] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:32 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:32.295328 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:32.296377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:32.297877 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:32.304123 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.304805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.305745 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.306722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.309691 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5488774b-5ce1-4414-9c4f-574802b087b2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.185131 Jul 29 04:48:32.311354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 108/204] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:32 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:32.380551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:32.389134 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f7971557-3153-4599-9b3a-e3d3827e86c8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.097393 Jul 29 04:48:32.389736 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 97/205] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:32 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:32.439277 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:32.439551 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:32.450350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.451116 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.452333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.453334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.588480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:32.597485 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2a5fc881-886d-43a4-820b-4739e13d97ae tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.164586 Jul 29 04:48:32.598173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 109/206] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:32 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:32.698890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:32.700109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:32.708311 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.709008 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.709990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:32.710772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:32.855210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:32.863288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4811d48b-f365-4846-9878-5cfe4b18edd4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.168418 Jul 29 04:48:32.864040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 98/207] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:32 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:33.304621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:33.305246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:33.312383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.312861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.313629 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.314089 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.332103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:33.332730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:33.339421 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.339881 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.340671 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.341116 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.406252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:33.426646 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:33.446042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:33.453349 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-814f3cb4-7101-49a2-b69f-9c16eb57cbaa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.152580 Jul 29 04:48:33.454144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 110/208] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:33 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:33.459208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:33.459831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:33.471553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:33.474578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.475250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.476100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.476638 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.479117 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0a50d0f1-738f-4ea5-94f8-0d9f73212ef4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.151715 Jul 29 04:48:33.479864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 99/209] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:33 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:33.542794 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:33.551584 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fbe979f7-afca-45ab-b0d3-404ffc879c53 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.096583 Jul 29 04:48:33.566925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 111/210] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:33 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:33.618791 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:33.619764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:33.625717 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:33.629593 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.630220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.631278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.632980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.691674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-ffe1bb7a-0a4d-4316-95b2-36354fc9b70c req-331d6e32-d9d7-4f81-9656-f306d40f5e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d225e6-c457-47da-bb55-5620ad7f15e7", "name": "network-vif-plugged", "status": "completed", "tag": "a62fbd73-0c26-4732-9cf9-7667cea10de3"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:33.703244 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-ffe1bb7a-0a4d-4316-95b2-36354fc9b70c req-331d6e32-d9d7-4f81-9656-f306d40f5e6c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.703958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-ffe1bb7a-0a4d-4316-95b2-36354fc9b70c req-331d6e32-d9d7-4f81-9656-f306d40f5e6c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.725818 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-ffe1bb7a-0a4d-4316-95b2-36354fc9b70c req-331d6e32-d9d7-4f81-9656-f306d40f5e6c service nova] Creating event network-vif-plugged:a62fbd73-0c26-4732-9cf9-7667cea10de3 for instance 94d225e6-c457-47da-bb55-5620ad7f15e7 on hv-cinder-85144 Jul 29 04:48:33.733959 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-ffe1bb7a-0a4d-4316-95b2-36354fc9b70c req-331d6e32-d9d7-4f81-9656-f306d40f5e6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049287 Jul 29 04:48:33.735823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 112/211] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:33.821030 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:33.830507 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ca75b4ed-ab67-49c4-b449-3fda6ca6c4ba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.215631 Jul 29 04:48:33.845535 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 100/212] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:33 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:33.885546 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:33.886254 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:33.897009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.897472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:33.898779 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:33.899219 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.072007 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:34.079495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-36d1f93c-c25d-43ea-9d47-d10df1d91e6c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.198641 Jul 29 04:48:34.080049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 113/213] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:33 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:34.476473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:34.477034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:34.483000 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.483482 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.484274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.484767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.499659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:34.500270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:34.504687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:34.507836 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.508291 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.509111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.509544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.625113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:34.633314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d235bb8d-9e21-4fa3-8e85-178febf4cef5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.161072 Jul 29 04:48:34.634206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 101/214] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:34 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:34.638971 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:34.639698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:34.646115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.646557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.647310 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.647737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.655528 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:34.664027 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ddb71f1e-ab0f-4da7-8ed7-546d152d0314 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.168146 Jul 29 04:48:34.667989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 114/215] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:34 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:34.714256 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:34.722097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-648df38b-f7db-44cb-8337-309525c38613 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.086415 Jul 29 04:48:34.722652 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 102/216] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:34 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:34.854545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:34.855159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:34.861255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.861862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.862631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:34.863074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:34.987568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:34.995359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-930622b8-3320-4b11-8916-ffe966993453 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.144621 Jul 29 04:48:34.996201 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 115/217] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:34 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:35.099812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:35.100426 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:35.106603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.107002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.107768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.108211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.235271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:35.243361 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-489ec509-aa27-457b-a08f-3e032abf2262 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.148064 Jul 29 04:48:35.243930 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 103/218] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:35 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:35.655149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:35.655741 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:35.662539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.662987 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.663754 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.664197 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.686026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:35.686722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:35.693308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.693838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.694655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.695178 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.798989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:35.806719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-de02765a-dd69-45c9-8789-c9a62a92481b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.155468 Jul 29 04:48:35.807289 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 116/219] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:35 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:35.820888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:35.820888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:35.820888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.820888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.821368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:35.821368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:35.823103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:35.831223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-de9b3b3d-6f0c-4851-9f01-251883f254c2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.148489 Jul 29 04:48:35.831798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 104/220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:35 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:35.880792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:35.887957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b588f2bc-db91-46c1-9718-05ddadac919e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.079622 Jul 29 04:48:35.888512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 117/221] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:35 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:36.017191 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:36.017775 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:36.024282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.024766 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.025525 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.025963 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.263778 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:36.264404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:36.271563 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.271941 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.272808 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.273281 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.357085 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:36.365118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-24c4fea2-7f3b-4ffb-92a6-d5d05b7ff28b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.351709 Jul 29 04:48:36.365724 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 105/222] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:36 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:36.402340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:36.410321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f080b92c-bce2-4fec-81a4-9dc4452eb2a9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.150786 Jul 29 04:48:36.410883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 118/223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:36 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:36.829758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:36.830424 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:36.836489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.836983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.837748 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.838188 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.851249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:36.851855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:36.857795 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.858239 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.858999 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.859431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.968092 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:36.975820 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5d7ad5d1-9246-4420-bc45-0d619376bf55 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.149932 Jul 29 04:48:36.976389 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 106/224] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:36 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:36.981135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:36.981881 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:36.990070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.990664 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.991492 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:36.992122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:36.995599 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:37.003509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c2d163ab-b5f8-4d7c-af55-84c1eda05fd1 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.156102 Jul 29 04:48:37.004069 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 119/225] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:36 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:37.053883 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:37.062904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c0be28f2-b558-4723-a89f-b57187e0de63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.085542 Jul 29 04:48:37.063472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 107/226] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:36 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:37.385558 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:37.386162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:37.392252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:37.392767 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:37.394366 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:37.394796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:37.431322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:37.431855 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:37.437890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:37.438342 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:37.439112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:37.439551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:37.522216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:37.529668 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-89c15786-5602-4f65-9bf1-0c874421f3a8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.147914 Jul 29 04:48:37.530244 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 120/227] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:37 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:37.573212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:37.581074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cd2dd8a7-086b-4015-841c-366312a58200 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.153211 Jul 29 04:48:37.581643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 108/228] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:37 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:37.997533 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:37.998140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:38.004255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.004727 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.005480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.005912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.023184 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:38.023785 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:38.029644 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.030086 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.030838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.031269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.137387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:38.144983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0c7c862d-ab32-45c9-ba20-c7c65e42a9ef tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.151267 Jul 29 04:48:38.145909 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 121/229] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:37 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:38.150744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:38.151211 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:38.157879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.158826 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.159754 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.160229 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.166800 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:38.175309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1862344f-6423-4354-914c-42ca5849a7a6 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.155876 Jul 29 04:48:38.175984 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 109/230] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:38 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:38.220134 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:38.228417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a7de573f-673d-4cfa-96bf-a6da8d264144 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1218 microversion: 2.1 time: 0.081275 Jul 29 04:48:38.229014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 122/231] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:38 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:38.551007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:38.551536 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:38.557775 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.558231 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.558992 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.559434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.602401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:38.603006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:38.608890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.609336 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.610093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:38.610526 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:38.694503 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:38.702934 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-282286b4-e9e7-4b28-ab70-90bb61755abd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.155941 Jul 29 04:48:38.703513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 110/232] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:38 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:38.742944 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:38.750485 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6d3373c1-2d21-4832-8343-e6ca2d6664c9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.151929 Jul 29 04:48:38.751055 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 123/233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:38 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:39.165452 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:39.166158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:39.175558 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.176027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.176845 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.177283 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.196689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:39.207476 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:39.215465 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.215910 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.218781 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.219226 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.376326 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:39.385794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-716b709c-fc7f-43e6-a781-8fe902c88811 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.224606 Jul 29 04:48:39.386816 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 111/234] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:39 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:39.393721 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:39.394367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:39.401377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.401832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.402710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.403154 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.447734 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:39.452423 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:39.461104 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-449d1e74-0c10-4fbc-a549-649473640cf3 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.268268 Jul 29 04:48:39.473339 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 124/235] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:39 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:39.482431 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:39.491935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c1e5eb23-a1ff-496e-802f-5525b8d97cc9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.103641 Jul 29 04:48:39.492955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 112/236] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:39 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:39.725579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:39.726290 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:39.733926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.734580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.735330 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.736019 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.771650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:39.772362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:39.782799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.783476 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.784401 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:39.790366 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:39.940186 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:39.940845 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:39.947976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-346ffe0b-c02e-465c-8b91-b13f4b6e185f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.180479 Jul 29 04:48:39.948269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-292ea688-5873-4757-a64d-5b3da75ba446 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.227859 Jul 29 04:48:39.948553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 113/237] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:39 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:39.948864 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 125/238] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:39 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:40.410472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:40.411221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:40.417428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.417886 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.418659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.419101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.483839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:40.485011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:40.492102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.492553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.493486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.493938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.557495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:40.567058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-db502cf6-2fcd-4fa5-9767-852b2743e2f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.161228 Jul 29 04:48:40.580919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 114/239] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:40 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:40.586269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:40.587036 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:40.593700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.594187 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.595119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.595751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.648237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:40.659037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8e4fe653-0028-4608-b7bf-5a9f283018b8 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.179569 Jul 29 04:48:40.659719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 126/240] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:40 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:40.672825 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:40.682103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c90d6bd5-37c4-4a19-b903-759ee0f53ce9 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.099818 Jul 29 04:48:40.682675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 115/241] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:40 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:40.968859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:40.969474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:40.969612 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:40.970086 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:40.975716 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.976169 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.976282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.976682 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.976964 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.977405 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:40.977495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:40.977876 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:41.109008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:41.110315 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:41.117529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-db84bdb4-c057-4f01-aee8-5c86daa0cc75 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.152510 Jul 29 04:48:41.118098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 127/242] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:40 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:41.118662 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-377d1a78-713c-4edb-9cba-aa690cf4180c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.153230 Jul 29 04:48:41.124114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 116/243] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:40 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:41.587509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:41.588155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:41.594207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:41.594660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:41.595427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:41.596479 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:41.679796 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:41.680489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:41.682480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:41.688030 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:41.688584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:41.689400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:41.690075 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:41.724147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:41.731756 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f0a46388-f298-4044-b85e-3603b778be11 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.148026 Jul 29 04:48:41.732343 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 128/244] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:41 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:41.737694 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:41.738303 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:41.744279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:41.744773 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:41.746146 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:41.747040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:41.820428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:41.826707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:41.834204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4cdea454-8cbe-4050-b0bc-4b429d292eea tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.100780 Jul 29 04:48:41.834895 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 129/245] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:41 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:41.835533 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-538c0b13-b7c8-45f9-92fc-233a14563754 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.159531 Jul 29 04:48:41.836108 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 117/246] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:41 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:42.139126 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:42.139659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:42.143754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:42.144368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:42.146531 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.147017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.147792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.148242 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.150263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.150709 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.151462 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.151892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.155722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:42.280446 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:42.280993 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:42.288806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-37c971b2-ce43-471f-9466-4701f7b059c0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.149501 Jul 29 04:48:42.289373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 118/247] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:42 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:42.289613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0165bc33-de59-48cd-9c76-43141e207a6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.154593 Jul 29 04:48:42.290252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 130/248] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:42 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:42.755861 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:42.756488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:42.762643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.763098 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.763862 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.764301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.856529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:42.857675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:42.865108 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.865768 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.866546 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.867189 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.898828 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:42.906451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9df52dda-fec9-4d71-8959-534a665dafad tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.154896 Jul 29 04:48:42.907254 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 119/249] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:42 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:42.911927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:42.912787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:42.918695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.919144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.919906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:42.920336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:42.983340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:42.992409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-10515ec3-cede-4ed4-b6d1-fb29cf3082c4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.084092 Jul 29 04:48:42.993125 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 120/250] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:42 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:42.999455 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:43.008202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-65a9fbea-a16c-4a4b-8660-575a27570857 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.155446 Jul 29 04:48:43.008799 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 131/251] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:42 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:43.310346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:43.310613 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:43.311081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:43.311380 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:43.317631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:43.318026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:43.318129 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:43.318474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:43.318835 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:43.319240 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:43.319345 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:43.319672 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:43.452157 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:43.455729 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:43.461463 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-87ccaf57-1141-4cd7-b21f-d4ec16e11b6f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.155153 Jul 29 04:48:43.462034 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 132/252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:43 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:43.463063 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ce804f84-e02c-487a-ab62-b1634a3f68e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.156812 Jul 29 04:48:43.463619 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 121/253] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:43 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:43.927210 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:43.927815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:43.933840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:43.934283 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:43.935038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:43.935471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.014011 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:44.014621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:44.022100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.022837 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.024032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.024478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.068659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:44.076081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c0b79a38-7126-48c1-a77b-95bd211d3363 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.152835 Jul 29 04:48:44.076671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 133/254] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:43 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:44.081912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:44.082517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:44.088517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.089010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.089516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:44.089778 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.090217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.098066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7084a42e-1189-4c62-92f8-089fd03f21bb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.088192 Jul 29 04:48:44.098649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 122/255] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:44 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:44.223018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:44.230518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bb6fb08e-1231-4a4e-bcb7-824abb0301c4 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.152840 Jul 29 04:48:44.231084 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 134/256] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:44 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:44.482614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:44.483343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:44.484390 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:44.485044 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:44.490158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.490683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.491442 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.491640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.491894 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.492001 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.492663 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:44.493130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:44.621209 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:44.621798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:44.628759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f33687fc-5ead-43de-85b1-bd9011ea9a4b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.148084 Jul 29 04:48:44.629334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 135/257] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:44 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:44.629449 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3703fe50-42a5-4ea9-926e-c71fd43e4ec9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.150602 Jul 29 04:48:44.629933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 123/258] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:44 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:45.097378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:45.098558 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:45.104883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.105424 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.106611 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.107088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.119857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:45.120469 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:45.128739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.129421 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.131256 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.131691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.206962 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:45.218237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fe947d6e-155d-48d8-854b-f97bb7fb70c2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.102874 Jul 29 04:48:45.231436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 124/259] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:45 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:45.252969 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:45.254189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:45.260217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:45.262829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.263291 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.264113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.264567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.268418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1c3f59d5-d12a-4044-bf8f-9efa4d6b5d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.175971 Jul 29 04:48:45.269238 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 136/260] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:45 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:45.409623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:45.417014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9bd91e4f-ec4c-4706-a86a-cc68373a7c69 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1314 microversion: 2.1 time: 0.169571 Jul 29 04:48:45.417584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 125/261] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:45 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:45.650943 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:45.651731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:45.660824 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.661282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.662233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.662679 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.666717 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:45.667414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:45.674522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.675037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.675872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.676484 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.832666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:45.841221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:45.848189 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1088ba4d-61b9-4f94-bdbf-c8be57a39ef6 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.202125 Jul 29 04:48:45.848858 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 137/262] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:45 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:45.865088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-68b9a789-6f04-4708-800c-f60609b6bb84 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.204778 Jul 29 04:48:45.865088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 126/263] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:45 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:45.865414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-37a00443-5f49-4ead-b928-6fc2ca187ff3 req-5c727666-8a77-4eb9-863f-2f110c32cee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3508a994-61f6-4db5-83be-063a6eedc0cd", "name": "network-vif-plugged", "status": "completed", "tag": "70e45860-f254-40d2-808c-c68bdc1a745b"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:45.865414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-37a00443-5f49-4ead-b928-6fc2ca187ff3 req-5c727666-8a77-4eb9-863f-2f110c32cee5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:45.865414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-37a00443-5f49-4ead-b928-6fc2ca187ff3 req-5c727666-8a77-4eb9-863f-2f110c32cee5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:45.875896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-37a00443-5f49-4ead-b928-6fc2ca187ff3 req-5c727666-8a77-4eb9-863f-2f110c32cee5 service nova] Creating event network-vif-plugged:70e45860-f254-40d2-808c-c68bdc1a745b for instance 3508a994-61f6-4db5-83be-063a6eedc0cd on hv-cinder-85144 Jul 29 04:48:45.881719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-37a00443-5f49-4ead-b928-6fc2ca187ff3 req-5c727666-8a77-4eb9-863f-2f110c32cee5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Jul 29 04:48:45.882727 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 138/264] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:46.240053 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:46.241296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:46.248033 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.248482 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.249269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.249700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.289833 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:46.290536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:46.297237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.297688 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.298459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.299536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.318800 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:46.327434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-380467a3-dd5d-409b-af7d-8da78930289e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.091922 Jul 29 04:48:46.328881 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 127/265] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:46 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:46.438262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:46.438994 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:46.445650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.449521 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:46.453123 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.458216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5aa1d048-4a9e-4802-8f46-4c38169a69f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.172685 Jul 29 04:48:46.458675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.459902 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.464422 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 139/266] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:46 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:46.617777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:46.629983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3b3c634a-b2a9-40d8-9244-086e9d98e71b tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1501 microversion: 2.1 time: 0.195441 Jul 29 04:48:46.636653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 128/267] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:46 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:46.871597 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:46.872770 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:46.873275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:46.874383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:46.880086 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.880855 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.881856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.882707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.898929 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.901852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:46.902746 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:46.903239 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:47.067197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:47.074796 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f2ca5fde-7cc6-4d8d-9514-8da52d76b781 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.206970 Jul 29 04:48:47.075367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 129/268] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:46 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:47.110473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:47.119358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3881b82c-8621-49d9-9657-63658f10671b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.254348 Jul 29 04:48:47.119932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 140/269] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:46 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:47.348882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:47.349497 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:47.355536 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:47.355990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:47.356799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:47.357243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:47.419147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:47.426929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a46369d1-94cd-4a6e-92e8-9410dde32d67 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.082501 Jul 29 04:48:47.427505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 130/270] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:47 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:47.480887 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:47.481631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:47.488212 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:47.488798 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:47.489660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:47.490092 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:47.651882 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:47.660168 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-81f25b38-e2ce-4f27-b19d-d3e7be8aba8b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.183300 Jul 29 04:48:47.668454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 141/271] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:47 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:48.096504 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:48.097391 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:48.106657 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.107147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.107953 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.108430 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.140802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:48.141419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:48.148083 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.148622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.149346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.149953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.154218 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:48.271858 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:48.283638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e904fb16-7fb1-4b00-aca9-951b6570e5cc tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.191136 Jul 29 04:48:48.284224 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 131/272] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:48 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:48.302876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:48.310734 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-09e12d53-e301-4b3c-b588-5bc18ca5e47c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.173652 Jul 29 04:48:48.311878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 142/273] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:48 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:48.447926 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:48.448792 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:48.455045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.455630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.456446 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.456918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.521674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:48.529129 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6ceefe8e-93cc-4f2f-b5e4-e64ac972f124 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.085138 Jul 29 04:48:48.529700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 132/274] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:48 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:48.681222 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:48.681918 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:48.685054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:48.688958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.689684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.690466 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:48.690908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:48.824528 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:48.833036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1351cd77-a5b9-441b-9249-e6e59cf4c48b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.155674 Jul 29 04:48:48.833621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 143/275] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:48 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:49.308595 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:49.313371 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:49.320771 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.321233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:49.322009 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.323115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:49.332844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:49.333458 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:49.339510 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.340220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:49.340771 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.341384 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:49.489065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:49.496642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:49.499558 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ee67ecfa-f9d5-494f-bc77-321d7d64bb39 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.197101 Jul 29 04:48:49.500317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 133/276] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:49 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:49.504926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6f6a3935-1fbf-4ba4-8bdd-c4c9888a8d23 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.176011 Jul 29 04:48:49.505490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 144/277] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:49 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:49.553197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:49.553197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:49.560477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.560965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:49.561733 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.562172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:49.624851 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:49.628963 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:48:49.633592 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1322700f-d254-4f84-8aff-18b0f2ab5d9e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.086013 Jul 29 04:48:49.634168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 134/278] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:49 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:49.853851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:49.854454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:49.860587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.861318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:49.862277 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:49.862854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:50.008341 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:50.016183 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0c7da898-012b-49ae-82e5-b81334b511bd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.166102 Jul 29 04:48:50.016782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 145/279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:49 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:50.521487 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:50.522106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:50.525474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:50.528628 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:50.528907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:50.529363 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:50.530165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:50.530605 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:50.535582 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:50.537294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:50.538102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:50.538519 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:50.697486 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:50.708553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a4d6b1d1-dac3-406c-bd4c-795930ef2d12 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1368 microversion: 2.1 time: 0.190591 Jul 29 04:48:50.709522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 135/280] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:50 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:50.712478 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:50.723269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-51976bc2-a1ee-4ea5-b4f2-989059dc62f9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1364 microversion: 2.1 time: 0.201520 Jul 29 04:48:50.724316 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 146/281] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:50 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:50.726229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:50.727142 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:50.737141 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:50.737591 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:50.738544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:50.739077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:50.807676 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:50.819497 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-dada8328-cd18-45e6-ab26-c2017cd2b99a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1266 microversion: 2.1 time: 0.108349 Jul 29 04:48:50.820097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 136/282] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:50 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:51.039329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:51.040069 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:51.056759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.057214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.058000 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.058439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.243105 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:51.250710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e3d10f59-2a00-4dcc-aaa6-c952e7053e3c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.216587 Jul 29 04:48:51.261971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 147/283] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:51 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:51.733603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:51.734913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:51.746716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.747511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.748294 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.748909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.753972 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:51.754675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:51.760933 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.761590 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.762531 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.763125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.887587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:51.896056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-19123b3a-5d85-4819-a588-9d570af83da8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1558 microversion: 2.1 time: 0.166504 Jul 29 04:48:51.896659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 137/284] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:51 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:51.901387 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:51.902075 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:51.908854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.909323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.910168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.910617 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.912764 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:51.920979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4484ab91-87ce-444a-8119-b56c9c8dd4ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1549 microversion: 2.1 time: 0.171103 Jul 29 04:48:51.921555 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 148/285] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:51 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:51.926249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7d2b4176-5d51-468a-a1b5-e3d13d6cd8f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:51.926793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7d2b4176-5d51-468a-a1b5-e3d13d6cd8f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:51.932943 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7d2b4176-5d51-468a-a1b5-e3d13d6cd8f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.933425 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7d2b4176-5d51-468a-a1b5-e3d13d6cd8f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.934189 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7d2b4176-5d51-468a-a1b5-e3d13d6cd8f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.934627 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7d2b4176-5d51-468a-a1b5-e3d13d6cd8f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.974187 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:51.981707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-abf9b225-c7dd-4ece-b855-a713e8a5f4f4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1274 microversion: 2.1 time: 0.083911 Jul 29 04:48:51.982285 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 138/286] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:51 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:51.987056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7409453a-68df-4843-a710-c448c201091a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:51.987554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7409453a-68df-4843-a710-c448c201091a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:51.993290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7409453a-68df-4843-a710-c448c201091a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.993749 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7409453a-68df-4843-a710-c448c201091a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:51.994517 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7409453a-68df-4843-a710-c448c201091a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:51.994957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7409453a-68df-4843-a710-c448c201091a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:52.049484 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7d2b4176-5d51-468a-a1b5-e3d13d6cd8f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126863 Jul 29 04:48:52.050076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 149/287] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:48:51 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:52.252029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7409453a-68df-4843-a710-c448c201091a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268123 Jul 29 04:48:52.261552 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 139/288] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:48:51 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:52.275944 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:52.276542 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:52.286155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:52.286616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:52.289567 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:52.291301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:52.324775 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a78c3e53-9d81-48fe-9bf7-ab0b471a2397 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "300311ed-20f0-40f2-a670-9a8450549259"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:52.327759 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a78c3e53-9d81-48fe-9bf7-ab0b471a2397 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:52.343695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a78c3e53-9d81-48fe-9bf7-ab0b471a2397 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:52.344149 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a78c3e53-9d81-48fe-9bf7-ab0b471a2397 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:52.347138 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a78c3e53-9d81-48fe-9bf7-ab0b471a2397 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:52.347608 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a78c3e53-9d81-48fe-9bf7-ab0b471a2397 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:52.685675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:52.694714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e61fc5ee-3ec7-4499-8c34-c6a3cf79d346 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.424126 Jul 29 04:48:52.695834 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 150/289] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:52 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:53.004424 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:53.006447 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:53.016170 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:53.016647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:53.018807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:53.019307 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:53.212625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:53.220615 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c8a90fc8-d190-42e4-a1e0-552562ade636 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1274 microversion: 2.1 time: 0.220572 Jul 29 04:48:53.221590 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 151/290] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:52 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:53.619682 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-827b66e6-668d-4ea6-8f03-635cfcc76c39 req-38853936-6b4a-4147-8af3-88e93097b026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94d225e6-c457-47da-bb55-5620ad7f15e7", "tag": "a62fbd73-0c26-4732-9cf9-7667cea10de3"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:53.631982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-827b66e6-668d-4ea6-8f03-635cfcc76c39 req-38853936-6b4a-4147-8af3-88e93097b026 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:53.633109 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-827b66e6-668d-4ea6-8f03-635cfcc76c39 req-38853936-6b4a-4147-8af3-88e93097b026 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:53.650184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-827b66e6-668d-4ea6-8f03-635cfcc76c39 req-38853936-6b4a-4147-8af3-88e93097b026 service nova] Creating event network-changed:a62fbd73-0c26-4732-9cf9-7667cea10de3 for instance 94d225e6-c457-47da-bb55-5620ad7f15e7 on hv-cinder-85144 Jul 29 04:48:53.658257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-827b66e6-668d-4ea6-8f03-635cfcc76c39 req-38853936-6b4a-4147-8af3-88e93097b026 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041999 Jul 29 04:48:53.660198 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 152/291] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:53.719679 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:53.721158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:53.729300 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:53.729882 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:53.730935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:53.732253 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:54.200105 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a78c3e53-9d81-48fe-9bf7-ab0b471a2397 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "POST /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.879162 Jul 29 04:48:54.201145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 140/292] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:48:52 2022] POST /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c/os-volume_attachments => generated 194 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:54.242225 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:54.242983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:54.275721 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:54.276345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:54.285566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:54.286021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:54.403042 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:54.414481 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d0fc1b83-5bfe-414e-9495-12fe45a6b8da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1284 microversion: 2.1 time: 0.176432 Jul 29 04:48:54.414853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 141/293] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:54 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:54.485414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:54.493843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d5e44c50-eb90-4713-adc9-728c32d39e08 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.780573 Jul 29 04:48:54.494443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 153/294] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:53 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:55.440060 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:55.442055 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:55.455699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:55.456335 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:55.457320 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:55.457981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:55.514420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-78d50fce-e26e-4b13-bb05-4c032b1fba97 req-ad2158c0-43df-475d-b802-cfdeb11035ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c9906c-fdab-4215-a1c5-5cb82c3ab79e", "tag": "df448b29-2557-4bee-808a-385ffcca1ff4"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:55.531557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-78d50fce-e26e-4b13-bb05-4c032b1fba97 req-ad2158c0-43df-475d-b802-cfdeb11035ce service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:55.532008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-78d50fce-e26e-4b13-bb05-4c032b1fba97 req-ad2158c0-43df-475d-b802-cfdeb11035ce service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:55.564396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-78d50fce-e26e-4b13-bb05-4c032b1fba97 req-ad2158c0-43df-475d-b802-cfdeb11035ce service nova] Creating event network-changed:df448b29-2557-4bee-808a-385ffcca1ff4 for instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e on hv-cinder-85144 Jul 29 04:48:55.567127 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:55.577007 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-78d50fce-e26e-4b13-bb05-4c032b1fba97 req-ad2158c0-43df-475d-b802-cfdeb11035ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066701 Jul 29 04:48:55.577301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6715e70e-473d-499f-8211-9a89b94c9eec tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1272 microversion: 2.1 time: 0.143836 Jul 29 04:48:55.577614 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 154/295] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:48:55.578527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 142/296] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:55 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:55.591935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:55.592693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:55.603997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:55.604961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:55.606051 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:55.606858 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:55.871741 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:55.882389 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4274f07e-2cea-4bbb-b932-469462744d5b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1322 microversion: 2.1 time: 0.303571 Jul 29 04:48:55.882983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 155/297] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:55 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:56.599714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:56.600472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:56.611561 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:56.612395 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:56.613394 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:56.614126 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:56.837809 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:56.847352 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-709ecd27-8efa-4d96-bd48-d212b51f6117 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.252464 Jul 29 04:48:56.848659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 143/298] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:56 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:56.903573 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:56.904281 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:56.912238 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:56.912792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:56.913675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:56.914169 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:57.135272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:57.144193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d1207db1-0401-4e9a-8500-27ff27feff9d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1516 microversion: 2.1 time: 0.244772 Jul 29 04:48:57.145042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 156/299] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:56 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:57.167963 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:57.170943 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:57.178703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:57.179328 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:57.180253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:57.180882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:57.214128 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lazy-loading 'flavor' on Instance uuid 3508a994-61f6-4db5-83be-063a6eedc0cd {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:48:57.377032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d436e698-78a0-44e3-94a4-33ade9e8c9f4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd/action" status: 200 len: 32 microversion: 2.1 time: 0.214618 Jul 29 04:48:57.378653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 144/300] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:48:57 2022] POST /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:48:57.389425 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:57.390334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:57.399938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:57.401509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:57.403155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:57.403835 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:57.800726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:57.812878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bd6e400a-d388-42b8-b511-833d0c806d9f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.426611 Jul 29 04:48:57.818303 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 157/301] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:57 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:57.871579 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:57.872515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:57.893159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:57.894959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:57.896491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:57.898206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:58.123100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-cc95d343-6f84-4e70-abc6-044bc91eba0d req-5b86f435-8cb8-4c99-b1ea-8dbbe409b35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe4d36d-6194-447a-9936-6d90fce16ed4", "tag": "d90ea8cb-bf7c-48a9-9383-979158877ae7"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:48:58.139467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-cc95d343-6f84-4e70-abc6-044bc91eba0d req-5b86f435-8cb8-4c99-b1ea-8dbbe409b35e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:58.139977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-cc95d343-6f84-4e70-abc6-044bc91eba0d req-5b86f435-8cb8-4c99-b1ea-8dbbe409b35e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:58.159054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-cc95d343-6f84-4e70-abc6-044bc91eba0d req-5b86f435-8cb8-4c99-b1ea-8dbbe409b35e service nova] Creating event network-changed:d90ea8cb-bf7c-48a9-9383-979158877ae7 for instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 on hv-cinder-85144 Jul 29 04:48:58.165098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-cc95d343-6f84-4e70-abc6-044bc91eba0d req-5b86f435-8cb8-4c99-b1ea-8dbbe409b35e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054123 Jul 29 04:48:58.166355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 158/302] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:48:58.257019 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:58.265610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cdf31bae-4c48-4939-bc80-87999d42d9cb tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.399716 Jul 29 04:48:58.266185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 145/303] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:57 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:48:58.839857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:58.840546 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:58.847184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:58.847628 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:58.848388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:58.849016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:58.987763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:58.995609 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1ea9e122-464f-4782-bad4-a08553b4e62c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.159971 Jul 29 04:48:59.001684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 159/304] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:58 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:48:59.287546 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:48:59.288324 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:48:59.294604 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:59.295061 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:59.296103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:48:59.296786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:48:59.453876 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:48:59.462651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a9ce23c8-c8f8-474d-9c03-4efca0dfeaf3 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.179941 Jul 29 04:48:59.463233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 146/305] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:48:59 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:00.018397 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:00.019002 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:00.024976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:00.025449 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:00.026206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:00.026640 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:00.157992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:00.165942 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8db1a308-cee2-4868-baf7-214030cdee4f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.151983 Jul 29 04:49:00.166501 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 160/306] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:00 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:00.484529 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:00.485158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:00.492916 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:00.493422 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:00.494203 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:00.494628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:00.638417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:00.647178 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-57176904-2698-4234-a9c6-cbc39a4a5700 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.166379 Jul 29 04:49:00.647763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 147/307] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:00 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:01.187483 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:01.188798 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:01.195276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:01.196018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:01.196971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:01.197412 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:01.202160 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:01.347098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:01.355023 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-35557779-0abb-434e-919c-b2f4bce99e06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.171484 Jul 29 04:49:01.355621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 161/308] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:01 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:01.668968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:01.670166 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:01.691308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:01.691796 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:01.692630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:01.693058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:01.720945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:02.043570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:02.052767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e5365ef3-9563-4d27-bed7-f60b9d12dcf2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.387895 Jul 29 04:49:02.053952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 148/309] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:01 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:02.376562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:02.377203 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:02.383812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:02.384451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:02.385772 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:02.386384 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:02.577210 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:02.586114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-aca315af-5b59-429f-b4c0-ed53ba03596c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.213616 Jul 29 04:49:02.586697 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 162/310] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:02 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:03.074504 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:03.075110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:03.082307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:03.082750 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:03.083509 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:03.083943 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:03.222118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:03.229541 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-54ce1b35-c657-44ba-8057-804f8ba1717c tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.158886 Jul 29 04:49:03.230104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 149/311] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:03 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:03.607105 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:03.607717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:03.613807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:03.614260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:03.615091 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:03.615534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:03.788949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:03.802100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0c02c9a8-5cdc-48b6-9732-d2ff8ea6b5bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.198484 Jul 29 04:49:03.803017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 163/312] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:03 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:04.251551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:04.252368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:04.258849 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:04.259298 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:04.260067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:04.260507 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:04.331318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-73515ef1-1982-470f-94d9-3635e9d8c107 req-8d291a22-0eb1-4504-ac0f-009109c3a101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe4d36d-6194-447a-9936-6d90fce16ed4", "name": "network-vif-plugged", "status": "completed", "tag": "d90ea8cb-bf7c-48a9-9383-979158877ae7"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:04.343272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-73515ef1-1982-470f-94d9-3635e9d8c107 req-8d291a22-0eb1-4504-ac0f-009109c3a101 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:04.344331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-73515ef1-1982-470f-94d9-3635e9d8c107 req-8d291a22-0eb1-4504-ac0f-009109c3a101 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:04.358383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-73515ef1-1982-470f-94d9-3635e9d8c107 req-8d291a22-0eb1-4504-ac0f-009109c3a101 service nova] Creating event network-vif-plugged:d90ea8cb-bf7c-48a9-9383-979158877ae7 for instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 on hv-cinder-85144 Jul 29 04:49:04.366019 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-73515ef1-1982-470f-94d9-3635e9d8c107 req-8d291a22-0eb1-4504-ac0f-009109c3a101 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038906 Jul 29 04:49:04.367061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 164/313] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:49:04.423792 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:04.431270 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-181e9ef8-2f67-4c83-8768-084033b6f211 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.184178 Jul 29 04:49:04.431821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 150/314] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:04 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:04.830380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:04.831310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:04.846605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:04.847060 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:04.847854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:04.848933 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:05.075691 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:05.084232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d550f8ec-109f-46de-b83a-f11893e0aba2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.261534 Jul 29 04:49:05.085053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 165/315] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:04 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:05.453436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:05.453980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:05.460894 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:05.461355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:05.462163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:05.462589 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:05.613435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:05.621964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-94b26349-7090-4d0b-949c-076fe1f0b0f8 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.171965 Jul 29 04:49:05.622671 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 151/316] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:05 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:06.107080 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:06.107879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:06.114964 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.115408 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.116169 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.116617 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.219728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:06.220773 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:06.227010 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.227653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.228588 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.229227 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.257412 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:06.259667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:49:06.265773 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-321a22a8-34a0-4848-9ef0-079073d8d8f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.163661 Jul 29 04:49:06.266353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 166/317] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:06 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:06.359750 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0275506a-d551-41d6-b9d6-9f180259a69d tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 204 len: 0 microversion: 2.1 time: 0.143519 Jul 29 04:49:06.360563 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 152/318] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:49:06 2022] DELETE /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 04:49:06.368795 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:06.369586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:06.376291 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.377350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.378064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.378509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.520749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:06.529120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4289f0c8-3753-4a1f-adca-222f0b82602c tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1553 microversion: 2.1 time: 0.164416 Jul 29 04:49:06.529692 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 167/319] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:06 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:06.644989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:06.645935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:06.653073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.653651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.654447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:06.654960 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:06.841982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:06.850653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ba9be187-882b-4bd2-a3a2-8775b20c729a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.209844 Jul 29 04:49:06.851226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 153/320] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:06 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:07.287343 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:07.288053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:07.294207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:07.294652 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:07.295670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:07.296103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:07.504685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:07.513370 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-44a2bc3b-f556-4686-bc0d-dec5aace09e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.229828 Jul 29 04:49:07.513940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 168/321] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:07 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:07.551386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:07.552003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:07.558504 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:07.558968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:07.559754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:07.560181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:07.750164 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:07.759059 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-39292856-ec71-42bf-9a72-19fe955cd0a2 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1553 microversion: 2.1 time: 0.212006 Jul 29 04:49:07.759634 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 154/322] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:07 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:07.873094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:07.874280 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:07.881306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:07.881760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:07.882530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:07.882966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:08.025389 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:08.034090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3900c960-f6ec-4b7b-8158-5e66c532fd1b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1314 microversion: 2.1 time: 0.165282 Jul 29 04:49:08.034687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 169/323] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:07 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:08.535051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:08.535692 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:08.541627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:08.542076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:08.542837 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:08.543269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:08.692155 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:08.699614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-81d08f01-386d-4dcb-88d3-c18c2db31bd1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.168945 Jul 29 04:49:08.700211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 155/324] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:08 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:08.779381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:08.780565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:08.786753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:08.787197 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:08.788194 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:08.788661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:08.923455 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:08.931815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-572306a0-e49b-49cd-90a3-8f121b6c1ce7 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1553 microversion: 2.1 time: 0.156181 Jul 29 04:49:08.932383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 170/325] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:08 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:09.063006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:09.063628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:09.071758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.072474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.073384 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.073977 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.232736 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:09.241184 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c76009e2-8d07-473c-93dd-9e9122e33749 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1498 microversion: 2.1 time: 0.189229 Jul 29 04:49:09.241751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 156/326] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:09 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:09.721284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:09.721898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:09.727933 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.728380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.729174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.729616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.865124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:09.873571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-dd1fcf14-e66c-477f-8b41-61f0836fbcd4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.156739 Jul 29 04:49:09.874208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 171/327] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:09 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:09.946523 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:09.948473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:09.953613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:09.953957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.955438 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:09.955643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.955911 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.956362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.962279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.962804 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.963648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:09.964153 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:09.982691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:49:10.074741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ac5aacc7-241e-4aaa-9dc5-39e47b62e04f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 204 len: 0 microversion: 2.1 time: 0.132075 Jul 29 04:49:10.075387 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 157/328] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:49:09 2022] DELETE /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:49:10.084688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:10.085494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:10.091751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:10.092283 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:10.093222 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:10.093674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:10.110038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:10.119262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-70beafab-c3ea-4fd6-a44d-42ff76700afe tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1553 microversion: 2.1 time: 0.169327 Jul 29 04:49:10.120020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 172/329] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:09 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:10.241602 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:10.250051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b5524806-6ea3-46c4-abd6-d22fb59b2b52 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1504 microversion: 2.1 time: 0.169584 Jul 29 04:49:10.250610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 158/330] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:10 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:10.898911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:10.899469 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:10.905453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:10.905901 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:10.906660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:10.907100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:11.036927 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:11.044324 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bd405a34-c6d3-4580-bf16-2314e2b0a941 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.149374 Jul 29 04:49:11.044915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 173/331] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:10 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:11.143542 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:11.144157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:11.150802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:11.151197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:11.151959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:11.152401 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:11.271176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:11.271633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:11.279276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:11.279724 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:11.280547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:11.281008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:11.281959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:11.295797 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-dfb71483-7afd-44aa-8905-9346b8228580 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1553 microversion: 2.1 time: 0.156682 Jul 29 04:49:11.296386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 159/332] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:11 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:11.427559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:11.435034 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f875388a-fdcd-4a2d-8225-cdf4bcbd7102 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1504 microversion: 2.1 time: 0.168137 Jul 29 04:49:11.435680 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 174/333] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:11 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:12.066683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:12.067290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:12.069378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:12.074726 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:12.075164 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:12.075933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:12.076370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:12.223570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:12.231267 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f0713799-d308-4fb6-9cc3-2e9d9a27ad06 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.168646 Jul 29 04:49:12.232387 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 160/334] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:12 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:12.319870 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:12.328200 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:12.337532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:12.338321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:12.339256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:12.339921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:12.457749 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:12.458897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:12.465798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:12.466528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:12.467627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:12.468148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:12.593231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:12.602925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ea7b7a78-1c15-4647-bbe0-62a218575e25 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1553 microversion: 2.1 time: 0.287712 Jul 29 04:49:12.604747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 175/335] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:12 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:12.631998 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:12.635781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:12.641786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-75e6f010-d8fb-4673-811f-ecf6863687e4 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1504 microversion: 2.1 time: 0.189073 Jul 29 04:49:12.642677 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 161/336] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:12 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:13.069684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-08dc9150-f738-46be-9950-5d9abf7361a8 req-6419d3c6-3d38-48cf-9705-f6f0bdf2942f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5786f4ef-cc00-4e18-9910-7ba1707d903c", "name": "network-vif-deleted", "tag": "9311cd5a-7a75-4479-a351-988245db7504"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:13.082180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-08dc9150-f738-46be-9950-5d9abf7361a8 req-6419d3c6-3d38-48cf-9705-f6f0bdf2942f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.085019 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-08dc9150-f738-46be-9950-5d9abf7361a8 req-6419d3c6-3d38-48cf-9705-f6f0bdf2942f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.098465 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-08dc9150-f738-46be-9950-5d9abf7361a8 req-6419d3c6-3d38-48cf-9705-f6f0bdf2942f service nova] Creating event network-vif-deleted:9311cd5a-7a75-4479-a351-988245db7504 for instance 5786f4ef-cc00-4e18-9910-7ba1707d903c on hv-cinder-85144 Jul 29 04:49:13.108310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-08dc9150-f738-46be-9950-5d9abf7361a8 req-6419d3c6-3d38-48cf-9705-f6f0bdf2942f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042451 Jul 29 04:49:13.109688 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 176/337] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:49:13.254241 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:13.255682 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:13.263101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.263591 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.264354 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.264829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.455632 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:13.463823 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-64ce697b-d8be-4a3d-a008-c50ec07478cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.214725 Jul 29 04:49:13.464775 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 162/338] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:13 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:13.625741 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:13.627076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:13.633439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.633883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.634634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.635086 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.663267 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:13.663957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:13.667505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.667954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.668417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lazy-loading 'fault' on Instance uuid 5786f4ef-cc00-4e18-9910-7ba1707d903c {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:49:13.669915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.670625 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.671400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.671836 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.704980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:13.705629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:13.706161 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lazy-loading 'fault' on Instance uuid 8fe4d36d-6194-447a-9936-6d90fce16ed4 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:49:13.714843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34242a2360f14710af2e8dbe6b704ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77688c4faed945849f5649c08cc580c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:13.722883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f9999f6f-f96a-41cd-8eaa-ab03d65e6735 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 200 len: 1350 microversion: 2.1 time: 0.101674 Jul 29 04:49:13.723593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 177/339] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:13 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:13.750556 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:13.758698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fe71214e-dfe5-4706-86fb-7c887e7d1809 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 200 len: 1304 microversion: 2.1 time: 0.099296 Jul 29 04:49:13.759253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 163/340] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:13 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:14.484310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:14.484935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:14.491728 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.492182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.492981 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.493686 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.626859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:14.630378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:14.635346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fbed2fa5-1dd7-4ac2-b987-db5f2f01701f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.154909 Jul 29 04:49:14.635908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 178/341] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:14 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:14.744541 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:14.745172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:14.752209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.752674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.753435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.753870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.768453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] HTTP exception thrown: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Request method failure captured: Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c HTTP/1.1 Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZdjWs7MyekqIe4RKGA1E9HjROx0Zh_PXcsMfyqkZIz4LOHH-QkDlKvzRZpSFWPGLbELvOg7XOxDrRtOfepaxV7n-GfCFq5u97T-VUgHJIv7znH03zJcsybEoW2ENXaWWKrwIK1pR8-yzMTq5VBjqhy1uGxTT-DFD0pb48diLVNOt8 Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:49:14.773029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_77688c4faed945849f5649c08cc580c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/77688c4faed945849f5649c08cc580c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 34242a2360f14710af2e8dbe6b704ca1 Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.774658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '5786f4ef-cc00-4e18-9910-7ba1707d903c'} Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:49:14.775491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.776910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.778089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Returning 404 to user: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:49:14.778089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-59d59d94-2e51-499f-964a-44e39b852218 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 404 len: 111 microversion: 2.1 time: 0.033930 Jul 29 04:49:14.778089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 164/342] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:14 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:49:14.780682 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:14.781348 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 8fe4d36d-6194-447a-9936-6d90fce16ed4] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:14.788420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.788923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.789701 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.790136 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.804322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] HTTP exception thrown: Instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 could not be found. Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Request method failure captured: Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 HTTP/1.1 Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42aTe5gJxAt0TU9g6akrnWvQGa3NlZtm5cNugjMFjjldG1tevi-6eQofh1YuWHJ8zES_4wCAqhBHjTWaAz85SP2CXO-0MG-yu0FRZZaUxRoJ3yp85ni0tx-Yto8QNYvObw5WO8O-56I-NpQwLxT-RL-vAbm1TFFSx5k_NbPfZjeTFAw Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: e52663d55be44e12b4aa939974e8e517 Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesActionsTest-473040373 Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:49:14.809231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52663d55be44e12b4aa939974e8e517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52663d55be44e12b4aa939974e8e517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52663d55be44e12b4aa939974e8e517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52663d55be44e12b4aa939974e8e517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesActionsTest-473040373 Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: e52663d55be44e12b4aa939974e8e517 Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesActionsTest-473040373 Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesActionsTest-473040373-project Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 87f97b8b406e442b93cbdda090d7e9ff Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesActionsTest-473040373-project Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 could not be found. Jul 29 04:49:14.810621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '8fe4d36d-6194-447a-9936-6d90fce16ed4'} Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 could not be found. Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:49:14.811454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 could not be found. Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 could not be found. Jul 29 04:49:14.812907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.814539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Returning 404 to user: Instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:49:14.814539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-15667204-b66a-4bf4-a526-bfb2bc44d35e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4" status: 404 len: 111 microversion: 2.1 time: 0.035281 Jul 29 04:49:14.814539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 179/343] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:14 2022] GET /compute/v2.1/servers/8fe4d36d-6194-447a-9936-6d90fce16ed4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:49:14.893925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:14.897014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:14.903643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.904089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.905066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:14.905557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:14.919353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] HTTP exception thrown: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Request method failure captured: Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c/os-volume_attachments HTTP/1.1 Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZdjWs7MyekqIe4RKGA1E9HjROx0Zh_PXcsMfyqkZIz4LOHH-QkDlKvzRZpSFWPGLbELvOg7XOxDrRtOfepaxV7n-GfCFq5u97T-VUgHJIv7znH03zJcsybEoW2ENXaWWKrwIK1pR8-yzMTq5VBjqhy1uGxTT-DFD0pb48diLVNOt8 Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:49:14.921472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_77688c4faed945849f5649c08cc580c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/77688c4faed945849f5649c08cc580c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 34242a2360f14710af2e8dbe6b704ca1 Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.922952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'server_id': '5786f4ef-cc00-4e18-9910-7ba1707d903c'} Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:49:14.923865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:14.924980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:14.926390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Returning 404 to user: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:49:14.926390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0d6edd2d-2b9b-4d94-ad5e-dddbb8f60d00 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034070 Jul 29 04:49:14.926390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 165/344] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:49:14 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:49:14.927601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1041051016", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "networks": [{"uuid": "48d67382-c2d3-47d5-b28b-aeebd485858a"}]}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:14.982598 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] validate_networks() for [('48d67382-c2d3-47d5-b28b-aeebd485858a', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:49:15.132384 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-c26d8357-dc66-4818-91c6-38359fd33fe0 req-aa29bdbe-1eb2-424c-93f1-5ef34f013b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe4d36d-6194-447a-9936-6d90fce16ed4", "name": "network-vif-deleted", "tag": "d90ea8cb-bf7c-48a9-9383-979158877ae7"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:15.142154 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-c26d8357-dc66-4818-91c6-38359fd33fe0 req-aa29bdbe-1eb2-424c-93f1-5ef34f013b00 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:15.142707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-c26d8357-dc66-4818-91c6-38359fd33fe0 req-aa29bdbe-1eb2-424c-93f1-5ef34f013b00 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:15.153987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-c26d8357-dc66-4818-91c6-38359fd33fe0 req-aa29bdbe-1eb2-424c-93f1-5ef34f013b00 service nova] Creating event network-vif-deleted:d90ea8cb-bf7c-48a9-9383-979158877ae7 for instance 8fe4d36d-6194-447a-9936-6d90fce16ed4 on hv-cinder-85144 Jul 29 04:49:15.159522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-c26d8357-dc66-4818-91c6-38359fd33fe0 req-aa29bdbe-1eb2-424c-93f1-5ef34f013b00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030837 Jul 29 04:49:15.160106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 166/345] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:49:15.552666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:49:15.553066 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:49:15.554753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:49:15.555183 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:49:15.555608 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:49:15.565580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:15.566209 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:15.567020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:15.567462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:15.586176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Getting quotas for project e52663d55be44e12b4aa939974e8e517. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:49:15.590667 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Getting quotas for user 87f97b8b406e442b93cbdda090d7e9ff and project e52663d55be44e12b4aa939974e8e517. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:49:15.603751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:49:15.606355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:49:15.655752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-db1cf613-6d20-4bc9-834c-d7a37c290c71 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735193 Jul 29 04:49:15.656488 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 180/346] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:49:15.661669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:15.662547 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:15.668355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4225cddc-15df-4193-8da5-281837cba463 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:15.668945 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4225cddc-15df-4193-8da5-281837cba463 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:15.670615 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:15.671236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:15.672195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:15.672992 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:15.729999 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4225cddc-15df-4193-8da5-281837cba463 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:15.738559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4225cddc-15df-4193-8da5-281837cba463 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1214 microversion: 2.1 time: 0.074121 Jul 29 04:49:15.739124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 181/347] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:15 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:15.824975 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:15.833284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5798b684-3d9e-4727-9f8f-4fe0cc35c398 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.179455 Jul 29 04:49:15.833841 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 167/348] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:15 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:16.136230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:16.136932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:16.149391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.149983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.150952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.151402 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.167056 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] HTTP exception thrown: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Request method failure captured: Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c HTTP/1.1 Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZdjWs7MyekqIe4RKGA1E9HjROx0Zh_PXcsMfyqkZIz4LOHH-QkDlKvzRZpSFWPGLbELvOg7XOxDrRtOfepaxV7n-GfCFq5u97T-VUgHJIv7znH03zJcsybEoW2ENXaWWKrwIK1pR8-yzMTq5VBjqhy1uGxTT-DFD0pb48diLVNOt8 Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:49:16.169106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_77688c4faed945849f5649c08cc580c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/77688c4faed945849f5649c08cc580c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 34242a2360f14710af2e8dbe6b704ca1 Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.170674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '5786f4ef-cc00-4e18-9910-7ba1707d903c'} Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:49:16.171453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.172486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.174028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Returning 404 to user: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:49:16.174028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fbec42db-23b5-4c6e-9fe4-40b49eedb1ef tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 404 len: 111 microversion: 2.1 time: 0.038388 Jul 29 04:49:16.174028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 182/349] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:49:16 2022] DELETE /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:49:16.179293 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:16.179899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] [instance: 5786f4ef-cc00-4e18-9910-7ba1707d903c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:16.186140 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.186594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.187365 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.187799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.203817 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] HTTP exception thrown: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Request method failure captured: Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c HTTP/1.1 Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZdjWs7MyekqIe4RKGA1E9HjROx0Zh_PXcsMfyqkZIz4LOHH-QkDlKvzRZpSFWPGLbELvOg7XOxDrRtOfepaxV7n-GfCFq5u97T-VUgHJIv7znH03zJcsybEoW2ENXaWWKrwIK1pR8-yzMTq5VBjqhy1uGxTT-DFD0pb48diLVNOt8 Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:49:16.206064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_77688c4faed945849f5649c08cc580c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/77688c4faed945849f5649c08cc580c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/77688c4faed945849f5649c08cc580c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 77688c4faed945849f5649c08cc580c2 Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-DeleteServersTestJSON-1017299837 Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 34242a2360f14710af2e8dbe6b704ca1 Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-DeleteServersTestJSON-1017299837-project Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.207557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '5786f4ef-cc00-4e18-9910-7ba1707d903c'} Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:49:16.208290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. Jul 29 04:49:16.209456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:49:16.210618 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] Returning 404 to user: Instance 5786f4ef-cc00-4e18-9910-7ba1707d903c could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:49:16.210618 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ec029e83-61df-47ba-b5ca-417d85a5cfc5 tempest-DeleteServersTestJSON-1017299837 tempest-DeleteServersTestJSON-1017299837-project] 10.222.0.40 "GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c" status: 404 len: 111 microversion: 2.1 time: 0.032001 Jul 29 04:49:16.210618 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 168/350] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:16 2022] GET /compute/v2.1/servers/5786f4ef-cc00-4e18-9910-7ba1707d903c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:49:16.761282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:16.762614 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:16.769499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.770295 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.771310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.771995 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.854415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:16.855654 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:16.858641 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:16.864962 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.866069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.867174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:16.867825 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:16.870373 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b2dfd78a-da28-470c-8ca3-09d90146db04 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1266 microversion: 2.1 time: 0.110745 Jul 29 04:49:16.883578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 183/351] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:16 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:17.192584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:17.202442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-547b3317-625d-4bfe-a2ff-46fc89843cc1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.352020 Jul 29 04:49:17.210144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 169/352] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:16 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:17.894613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:17.895984 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:17.908245 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:17.914861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:17.915616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:17.917270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:17.917935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:18.178123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:18.193033 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8b12d300-c020-44b7-b97a-2ea7ed0e67ab tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.305372 Jul 29 04:49:18.193695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 184/353] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:17 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:18.229136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:18.230637 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:18.240516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:18.241256 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:18.242374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:18.243124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:18.523434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:18.531807 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-480fa213-55ff-41ff-a3e0-7dd22b725452 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.309613 Jul 29 04:49:18.546276 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 170/354] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:18 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:19.218176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:19.220771 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:19.233979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:19.234613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:19.237936 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:19.239305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:19.378457 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-364eee46-926c-4475-8313-87660c73f8e1 req-ee2a6e81-a54a-4776-a3e7-d9404282b165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81", "tag": "aa4b3ede-1fb6-40cc-862c-da417c00ce02"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:19.393165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-364eee46-926c-4475-8313-87660c73f8e1 req-ee2a6e81-a54a-4776-a3e7-d9404282b165 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:19.393621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-364eee46-926c-4475-8313-87660c73f8e1 req-ee2a6e81-a54a-4776-a3e7-d9404282b165 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:19.410887 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-364eee46-926c-4475-8313-87660c73f8e1 req-ee2a6e81-a54a-4776-a3e7-d9404282b165 service nova] Creating event network-changed:aa4b3ede-1fb6-40cc-862c-da417c00ce02 for instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 on hv-cinder-85144 Jul 29 04:49:19.421367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-364eee46-926c-4475-8313-87660c73f8e1 req-ee2a6e81-a54a-4776-a3e7-d9404282b165 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052148 Jul 29 04:49:19.423318 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 171/355] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:49:19.555656 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:19.556386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:19.564011 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:19.564870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:19.565670 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:19.566283 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:19.576523 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:19.589736 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fbe18896-7355-4dba-a673-81ae34aa37da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.377491 Jul 29 04:49:19.591787 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 185/356] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:19 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:19.780557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:19.789468 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f2540a4c-ec56-4176-a2f4-72912a504ce5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.238902 Jul 29 04:49:19.790053 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 172/357] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:19 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:20.613992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:20.615246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:20.621911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:20.622443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:20.623457 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:20.624046 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:20.817022 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:20.822085 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:20.838420 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:20.839511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:20.841333 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:20.842202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:21.125674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:21.146945 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:21.158601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-47321319-42d1-4f99-b69c-0292158c706d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.549468 Jul 29 04:49:21.158769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ccaa02eb-c390-4f9c-88de-a4500d6498ee tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.346375 Jul 29 04:49:21.166300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 173/358] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:20 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:21.173681 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 186/359] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:20 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:22.179065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:22.179670 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:22.186650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:22.187108 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:22.188003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:22.188661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:22.194264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:22.195562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:22.202481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:22.202939 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:22.204379 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:22.205619 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:22.341201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:22.349272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cd46e7b6-339e-465b-bb8f-227735d164da tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.173963 Jul 29 04:49:22.349910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 174/360] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:22 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:22.353117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:22.361249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4509ac96-100c-4e44-a0ed-4a59c74a3f78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.172289 Jul 29 04:49:22.364931 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 187/361] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:22 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:23.370311 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:23.370982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:23.378234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:23.378851 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:23.379993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:23.380531 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:23.391497 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:23.392791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:23.400759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:23.401429 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:23.402576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:23.403084 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:23.577090 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:23.590320 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-12444f24-ff25-43b5-aaa9-0101590fb880 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.224201 Jul 29 04:49:23.590908 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 175/362] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:23 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:23.624052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:23.631999 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ae634130-d721-4ebe-8cdd-e1dc82e89300 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.253537 Jul 29 04:49:23.632893 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 188/363] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:23 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:24.613923 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:24.614548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:24.622848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:24.623696 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:24.624668 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:24.625468 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:24.659635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:24.660894 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:24.674278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:24.677832 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:24.679485 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:24.680999 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:24.892099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:24.901299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4ff73bcb-cd99-45bf-a903-95c767b9afbc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.245904 Jul 29 04:49:24.904675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 189/364] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:24 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:25.121505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:25.129431 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c790a564-5144-45e0-b5f9-13f21a6b6312 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.520425 Jul 29 04:49:25.130673 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 176/365] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:24 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:25.926418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:25.927202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:25.930686 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:25.931612 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=8 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:25.937589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:25.938924 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:25.939718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:25.940165 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:26.093468 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:26.101487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-881aeeaa-8374-4185-9ebc-b4d1aaca738f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.179417 Jul 29 04:49:26.102201 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 190/366] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:25 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:26.150719 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:26.151769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:26.160592 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:26.161224 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:26.162341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:26.163005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:26.377095 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:26.385023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a04c6dd7-26be-4de6-9086-4e833bb2513e tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.238142 Jul 29 04:49:26.385689 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 177/367] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:26 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:27.123996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:27.124649 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:27.134395 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:27.134861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:27.136113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:27.137109 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:27.303888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:27.312198 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6f689ab0-8f0d-41f5-923f-f574a477eda9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.193034 Jul 29 04:49:27.315972 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 191/368] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:27 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:27.406143 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:27.407303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:27.414326 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:27.414798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:27.415629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:27.416076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:27.574813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:27.592677 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c3f7b8a5-da33-404e-9d64-fc915fff750b tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.189108 Jul 29 04:49:27.605461 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 178/369] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:27 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:27.701493 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4c625be5-c8bb-4e1f-a382-e7ce3e3c3ad4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'create', calling method: .version_select at 0x7f3c545bb4c0>, body: {"keypair": {"name": "tempest-keypair-1015974218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7Ak3RI9glkDnRPCbE+E256SGAAjYXRK2eaU4VH8sgdUWnchXM2gq7aqe5AW8U+fLTZfnqDQf9v3rM44n8CPoWHZ7R4iCLJCsgB+4gRQD+vZv9jmvWUqLrJrwzZSPNHmA=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:27.719813 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-4c625be5-c8bb-4e1f-a382-e7ce3e3c3ad4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for project f8e9e21d168140e99ffed71146e35fc4. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:49:27.724905 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-4c625be5-c8bb-4e1f-a382-e7ce3e3c3ad4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for user a1e1c24849d7480b8ac804a7e3d2ab5a and project f8e9e21d168140e99ffed71146e35fc4. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:49:27.757428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4c625be5-c8bb-4e1f-a382-e7ce3e3c3ad4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.272708 Jul 29 04:49:27.764511 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 192/370] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Jul 29 04:49:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 280 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 29 04:49:27.783524 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-d667b56c-7409-4078-ad40-dc2431450622 req-09eaabca-d244-418d-a053-63cef3e94814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81", "name": "network-vif-plugged", "status": "completed", "tag": "aa4b3ede-1fb6-40cc-862c-da417c00ce02"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:27.798312 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-d667b56c-7409-4078-ad40-dc2431450622 req-09eaabca-d244-418d-a053-63cef3e94814 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:27.799228 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-d667b56c-7409-4078-ad40-dc2431450622 req-09eaabca-d244-418d-a053-63cef3e94814 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:27.812234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-d667b56c-7409-4078-ad40-dc2431450622 req-09eaabca-d244-418d-a053-63cef3e94814 service nova] Creating event network-vif-plugged:aa4b3ede-1fb6-40cc-862c-da417c00ce02 for instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 on hv-cinder-85144 Jul 29 04:49:27.818920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-d667b56c-7409-4078-ad40-dc2431450622 req-09eaabca-d244-418d-a053-63cef3e94814 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Jul 29 04:49:27.821007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 179/371] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:49:28.340383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:28.342293 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:28.353344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:28.353998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:28.354932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:28.355515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:28.591442 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:28.600928 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e980643f-a552-4e7a-afa0-34c5fa0ddc36 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.265879 Jul 29 04:49:28.601511 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 193/372] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:28 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:28.621090 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:28.622416 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:28.630308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:28.630847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:28.631641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:28.632118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:28.774247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:28.783930 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9fae9a82-e161-4e09-8c2c-e1dd48e3dff2 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.169604 Jul 29 04:49:28.784516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 180/373] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:28 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:29.323109 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1510085349", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8994c62-2968-491e-9d89-ada7a08f8ea0"}], "security_groups": [{"name": "tempest-securitygroup--637853330"}], "key_name": "tempest-keypair-1015974218", "user_data": "}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:29.454249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] validate_networks() for [('c8994c62-2968-491e-9d89-ada7a08f8ea0', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:49:29.624941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:29.625998 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:29.636337 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:29.638249 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:29.640163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:29.644162 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:29.820363 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:29.830368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6aae7db1-621d-4c94-92c2-0b7fe4a20a28 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.209298 Jul 29 04:49:29.831489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 181/374] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:29 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:29.850798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:29.852189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:29.870488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:29.873146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:29.874254 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:29.875979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:29.892084 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:49:29.892744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:49:29.893378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:49:29.893937 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:49:29.894221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:29.895087 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:49:29.904663 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:29.905349 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:29.906310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:29.907296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:29.926487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for project f8e9e21d168140e99ffed71146e35fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:49:29.930923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for user a1e1c24849d7480b8ac804a7e3d2ab5a and project f8e9e21d168140e99ffed71146e35fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:49:29.943494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:49:29.946304 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:49:29.999809 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-71de7a25-971c-455c-96c0-13e22e16c831 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.681159 Jul 29 04:49:30.008024 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 194/375] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Jul 29 04:49:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 29 04:49:30.014197 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4988d24f-eb50-4d03-9876-663868839757 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:30.015004 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4988d24f-eb50-4d03-9876-663868839757 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:30.021217 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:30.030313 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-93e4e1d3-fce7-4370-b49a-e9e99399fb0a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1314 microversion: 2.1 time: 0.197470 Jul 29 04:49:30.040303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 182/376] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:29 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:30.075280 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4988d24f-eb50-4d03-9876-663868839757 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:30.082996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4988d24f-eb50-4d03-9876-663868839757 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:30.084513 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4988d24f-eb50-4d03-9876-663868839757 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:30.086480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4988d24f-eb50-4d03-9876-663868839757 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1282 microversion: 2.20 time: 0.077178 Jul 29 04:49:30.087048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 195/377] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:30 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:30.853644 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:30.854162 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:30.866705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:30.867519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:30.868532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:30.869223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:31.036451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:31.043966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8443ad75-83bb-4ca3-92fd-1279b747b87a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.194245 Jul 29 04:49:31.058314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 183/378] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:30 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:31.058825 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:31.059979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:31.068896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:31.069563 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:31.070535 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:31.071133 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:31.112702 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:31.115325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:31.128630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:31.129100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:31.135579 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:31.136278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:31.205202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:31.214369 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:31.215897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:31.217077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8ffba491-8fba-40c4-a8c4-beb489e5d5fb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1334 microversion: 2.20 time: 0.111368 Jul 29 04:49:31.217634 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 184/379] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:31 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:31.231778 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:31.238468 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-09482b09-0708-4a9e-bfc7-2d2ddf2a9eed tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1499 microversion: 2.1 time: 0.185139 Jul 29 04:49:31.239052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 196/380] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:31 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1499 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:32.067597 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:32.068053 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:32.072374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:32.073395 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:32.079785 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.080434 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.080584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.081876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.082465 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.083260 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.085073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.086725 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.124486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Going to try to terminate instance {{(pid=129684) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:49:32.238768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:32.248208 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2748e62a-e83c-4eff-9feb-d31ca0c0b270 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.185611 Jul 29 04:49:32.249740 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 185/381] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:32 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:32.254971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bb68a7d6-bbfc-4324-9703-843dfcc53e01 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 204 len: 0 microversion: 2.1 time: 0.190068 Jul 29 04:49:32.255365 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:32.255809 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 197/382] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:49:32 2022] DELETE /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 04:49:32.256037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:32.265986 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:32.267698 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:32.271209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.273660 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.274698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.275307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.275976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.276518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.277661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:32.278915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:32.342821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:32.352354 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:32.353968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:32.355102 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-61e5bbff-9322-43a4-ab6b-5713ff670ad5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1340 microversion: 2.20 time: 0.103791 Jul 29 04:49:32.355997 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 186/383] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:32 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:32.490722 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:32.506669 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2e31c153-4f37-4265-94c4-710f9259727a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1505 microversion: 2.1 time: 0.245809 Jul 29 04:49:32.507267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 198/384] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:32 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:33.271344 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:33.271946 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:33.278327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:33.278801 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:33.279554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:33.279984 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:33.379013 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:33.379629 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:33.385830 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:33.386368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:33.387244 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:33.387755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:33.406767 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:33.411390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:33.419222 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9dbc502e-7fa5-4eb2-8055-f6b8a051cd78 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.151654 Jul 29 04:49:33.420075 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 187/385] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:33 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:33.527397 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:33.528345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:33.533173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:33.534694 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:33.535182 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:33.535966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:33.536411 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:33.541421 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:33.542953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:33.544049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-97501a3c-6dc9-4105-baed-121646736029 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.169804 Jul 29 04:49:33.544687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 199/386] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:33 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:33.677544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:33.685091 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1275b626-5926-40b2-bf21-d3c10a356923 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1505 microversion: 2.1 time: 0.161618 Jul 29 04:49:33.685661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 188/387] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:33 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:34.442402 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:34.443036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:34.449028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:34.449473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:34.450222 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:34.450649 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:34.566793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:34.567396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:34.573768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:34.574236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:34.574966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:34.575398 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:34.576651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:34.584847 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3c4ba4c6-d742-407f-b294-19cc2be7902f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.146381 Jul 29 04:49:34.585414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 200/388] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:34 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:34.708137 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:34.709070 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:34.713247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:34.715214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:34.715727 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:34.716552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:34.717073 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:34.721322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:34.722852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:34.723966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b378c1f5-ba7c-4df6-8c41-cff88f385948 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.161120 Jul 29 04:49:34.724522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 189/389] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:34 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:34.852693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:34.860117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f9cbe3c8-3446-48da-8dc2-237756816dfd tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1505 microversion: 2.1 time: 0.156737 Jul 29 04:49:34.860701 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 201/390] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:34 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:35.606681 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:35.607304 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:35.614597 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:35.615057 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:35.615828 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:35.616271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:35.746036 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:35.746618 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:35.747230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:35.753372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:35.753823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:35.753959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fe8fe06d-205e-49d4-9aa3-5530dab861fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.151156 Jul 29 04:49:35.754532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 190/391] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:35 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:35.754651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:35.755016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:35.881322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:35.882097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:35.888373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:35.888914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:35.889705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:35.890151 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:36.020702 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:36.023135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:36.029127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:36.030548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-837f1837-4399-4ec4-b8e4-706c74a3408d tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1505 microversion: 2.1 time: 0.153152 Jul 29 04:49:36.030782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:36.031148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 191/392] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:35 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:36.032093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f075f1be-1ff2-4aab-84b6-acadbc220970 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.289389 Jul 29 04:49:36.032673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 202/393] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:35 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:36.775275 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:36.775895 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:36.783077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:36.783531 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:36.784296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:36.784782 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:36.918150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:36.926104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-78f333c9-1934-4611-93a2-a49e6591d7be tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.154709 Jul 29 04:49:36.926674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 192/394] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:36 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:37.051760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:37.052374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:37.053643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:37.054255 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:37.058496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:37.058950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:37.059726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:37.060167 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:37.060271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:37.060650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:37.061410 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:37.061844 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:37.198515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:37.208317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:37.209912 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:37.211065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a8f8950b-6994-40cf-84dd-bf72907b9a55 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.161188 Jul 29 04:49:37.220730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 193/395] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:37 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:37.446054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:37.453466 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1e7593de-657f-4aee-9f06-10058b518cfa tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1505 microversion: 2.1 time: 0.405617 Jul 29 04:49:37.454021 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 203/396] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:37 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:37.948976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:37.951573 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:37.960220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:37.960703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:37.961550 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:37.961947 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:38.003296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-b78cb280-a23c-41f8-bb69-2f29f9d83f8d req-36ad39a1-3713-4f31-983f-40a53f32504b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630ff067-c10b-4ae9-8d92-c40d206fd0ca", "tag": "1f4eb45a-ea71-4ede-b569-032c9dddfac4"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:38.014760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b78cb280-a23c-41f8-bb69-2f29f9d83f8d req-36ad39a1-3713-4f31-983f-40a53f32504b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:38.015216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b78cb280-a23c-41f8-bb69-2f29f9d83f8d req-36ad39a1-3713-4f31-983f-40a53f32504b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:38.029267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-b78cb280-a23c-41f8-bb69-2f29f9d83f8d req-36ad39a1-3713-4f31-983f-40a53f32504b service nova] Creating event network-changed:1f4eb45a-ea71-4ede-b569-032c9dddfac4 for instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca on hv-cinder-85144 Jul 29 04:49:38.036016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-b78cb280-a23c-41f8-bb69-2f29f9d83f8d req-36ad39a1-3713-4f31-983f-40a53f32504b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037884 Jul 29 04:49:38.037862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 204/397] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:49:38.122814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:38.131262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9f2ec5e9-511a-4197-82d2-5b27e564240e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.187507 Jul 29 04:49:38.131852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 194/398] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:37 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:38.234755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:38.235455 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:38.241640 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:38.242088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:38.242844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:38.243279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:38.384472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:38.393271 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:38.394789 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:38.395892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-add6c286-e7e4-4d49-b357-94760e61e348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.165726 Jul 29 04:49:38.396452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 205/399] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:38 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:38.474036 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:38.474641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:38.480626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:38.481083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:38.481835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:38.482269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:38.610528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:38.618313 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f06dfdd7-1713-483c-993e-66dd4d5f3457 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1505 microversion: 2.1 time: 0.148087 Jul 29 04:49:38.618876 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 195/400] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:38 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:39.152992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:39.153606 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:39.160159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:39.160626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:39.161419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:39.161860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:39.419627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:39.420516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:39.427716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:39.428367 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:39.429220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:39.429672 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:39.554664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:39.562829 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-854a1fe1-dc0e-478e-9bd4-8bc5ccc1d71b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.413616 Jul 29 04:49:39.576822 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 206/401] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:39 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:39.577636 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:39.587251 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:39.589176 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:39.590577 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-46c4119a-3dec-4b86-b3f2-516f87e8c22a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.176366 Jul 29 04:49:39.591413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 196/402] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:39 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:39.648631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:39.649955 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:39.658603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:39.659326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:39.660585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:39.661303 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:39.917009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:39.977052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:39.985950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-65c076b2-2194-4a53-b627-119e21e4e14a tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1505 microversion: 2.1 time: 0.349159 Jul 29 04:49:39.993001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 207/403] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:39 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:40.118643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-32de2230-6ee1-4805-8480-dd3080b91cb7 req-13913d39-2c34-4e87-b958-a3fbc02d1d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81", "name": "network-vif-deleted", "tag": "aa4b3ede-1fb6-40cc-862c-da417c00ce02"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:40.131301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-32de2230-6ee1-4805-8480-dd3080b91cb7 req-13913d39-2c34-4e87-b958-a3fbc02d1d5d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:40.132088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-32de2230-6ee1-4805-8480-dd3080b91cb7 req-13913d39-2c34-4e87-b958-a3fbc02d1d5d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:40.144167 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-32de2230-6ee1-4805-8480-dd3080b91cb7 req-13913d39-2c34-4e87-b958-a3fbc02d1d5d service nova] Creating event network-vif-deleted:aa4b3ede-1fb6-40cc-862c-da417c00ce02 for instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 on hv-cinder-85144 Jul 29 04:49:40.149325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-32de2230-6ee1-4805-8480-dd3080b91cb7 req-13913d39-2c34-4e87-b958-a3fbc02d1d5d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036780 Jul 29 04:49:40.150111 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 197/404] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:49:40.585471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:40.586090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:40.588278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=12 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:40.594172 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:40.594630 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:40.595385 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:40.595819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:40.615269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:40.616067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:40.622742 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:40.623198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:40.623969 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:40.624408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:40.730131 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:40.738908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a40ba57e-c6a5-49d6-bdab-a37a54ac5e8a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.157631 Jul 29 04:49:40.739672 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 208/405] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:40 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:40.764872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:40.772977 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:40.775005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:40.776114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9bcc5925-48bf-489f-90c2-0f6326647522 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.165197 Jul 29 04:49:40.776759 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 198/406] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:40 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:41.007398 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:41.008006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:41.014163 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:41.014644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:41.016065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:41.016065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:41.050341 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:41.050916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:41.051470 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lazy-loading 'fault' on Instance uuid 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:49:41.304074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:41.311589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7e07b34a-418f-46c2-80d3-c526f86f5f63 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1304 microversion: 2.1 time: 0.308065 Jul 29 04:49:41.312290 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 209/407] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:41 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1304 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:41.760914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:41.761662 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:41.768486 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:41.769012 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:41.769786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:41.770232 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:41.788286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:41.800640 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:41.801248 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:41.807809 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:41.808265 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:41.809098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:41.809536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:41.948366 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:41.956898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:41.958425 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:41.959561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-01dcfcaa-ff54-43c7-855c-6673060a95a8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.163336 Jul 29 04:49:41.960128 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 210/408] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:41 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:42.183778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:42.194078 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1d5419f3-be73-483c-9f84-1d166b1a2664 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.436391 Jul 29 04:49:42.195003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 199/409] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:41 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:42.334487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:42.335101 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:42.341311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:42.341766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:42.342529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:42.343156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:42.375948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:42.376712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:42.377189 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lazy-loading 'fault' on Instance uuid 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:49:42.426131 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:42.434413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5c10c9a0-c258-423c-9035-0701a02c2455 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1304 microversion: 2.1 time: 0.103818 Jul 29 04:49:42.447834 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 211/410] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:42 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:42.983062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:42.983849 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:42.986909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=82 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:42.992896 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:42.993349 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:42.994157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:42.994604 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:43.127843 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:43.135845 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:43.137404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:43.138554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-40191de6-e6e4-47e3-ace1-0488492dadfb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.159684 Jul 29 04:49:43.139122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 200/411] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:42 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:43.215182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:43.215796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:43.222502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:43.222949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:43.223714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:43.224150 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:43.359426 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:43.366921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4a19b1da-5352-4c64-ae38-7b255f1d84d6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.155558 Jul 29 04:49:43.367480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 212/412] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:43 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:43.457067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:43.457683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:43.465026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:43.465482 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:43.466455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:43.467106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:43.520442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:43.521605 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:43.522085 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lazy-loading 'fault' on Instance uuid 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:49:43.583357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f97b8b406e442b93cbdda090d7e9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52663d55be44e12b4aa939974e8e517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:43.593372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-66aa5ee3-d1c3-4f81-a12c-f59fe249b8a0 tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 200 len: 1304 microversion: 2.1 time: 0.141697 Jul 29 04:49:43.593965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 201/413] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:43 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:44.161475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:44.162137 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:44.168277 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:44.168763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:44.169518 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:44.170246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:44.305924 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:44.314999 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:44.316450 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:44.317626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-87e0de90-d61b-45f5-994f-cdd061ba5186 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.160072 Jul 29 04:49:44.318524 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 213/414] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:44 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:44.389701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:44.390520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:44.396927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:44.397378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:44.398144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:44.398581 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:44.533702 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:44.552927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4a86424c-2998-42f4-a7cc-9683c9775ff4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.155790 Jul 29 04:49:44.552927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 202/415] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:44 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:44.616022 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:44.616587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] [instance: 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:44.623594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:44.624049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:44.625080 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:44.625530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:44.640796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] HTTP exception thrown: Instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 could not be found. Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Request method failure captured: Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 HTTP/1.1 Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42aTe5gJxAt0TU9g6akrnWvQGa3NlZtm5cNugjMFjjldG1tevi-6eQofh1YuWHJ8zES_4wCAqhBHjTWaAz85SP2CXO-0MG-yu0FRZZaUxRoJ3yp85ni0tx-Yto8QNYvObw5WO8O-56I-NpQwLxT-RL-vAbm1TFFSx5k_NbPfZjeTFAw Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: e52663d55be44e12b4aa939974e8e517 Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesActionsTest-473040373 Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:49:44.642444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52663d55be44e12b4aa939974e8e517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52663d55be44e12b4aa939974e8e517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52663d55be44e12b4aa939974e8e517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52663d55be44e12b4aa939974e8e517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesActionsTest-473040373 Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: e52663d55be44e12b4aa939974e8e517 Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesActionsTest-473040373 Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesActionsTest-473040373-project Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 87f97b8b406e442b93cbdda090d7e9ff Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesActionsTest-473040373-project Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 could not be found. Jul 29 04:49:44.643803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81'} Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 could not be found. Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:49:44.644643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 could not be found. Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 could not be found. Jul 29 04:49:44.646135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:49:44.648027 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] Returning 404 to user: Instance 9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:49:44.648027 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7fa840c4-3c16-4b06-991b-661bef19f57f tempest-VolumesActionsTest-473040373 tempest-VolumesActionsTest-473040373-project] 10.222.0.40 "GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81" status: 404 len: 111 microversion: 2.1 time: 0.031662 Jul 29 04:49:44.648027 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 214/416] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:44 2022] GET /compute/v2.1/servers/9a43a6d4-64bc-43fa-bc6e-c1b1c4492c81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:49:45.341670 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:45.342278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:45.348531 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:45.349024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:45.349785 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:45.350226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:45.488763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:45.498245 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:45.501018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:45.502316 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f1c62392-c669-4032-82d4-d5fbd91fad01 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.164590 Jul 29 04:49:45.502904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 203/417] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:45 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:45.565704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:45.566307 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:45.569189 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:45.572807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:45.573193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:45.573947 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:45.574664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:45.720723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:45.728413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-dc35e45a-6e38-4b97-914c-cd9ccf5d2818 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.167116 Jul 29 04:49:45.743316 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 215/418] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:45 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:45.747810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-2983be45-24ee-4ebb-b6b3-e0ba0eb337cc req-7a72fc2b-6710-47c0-b7a5-cbd2ea66e2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630ff067-c10b-4ae9-8d92-c40d206fd0ca", "name": "network-vif-plugged", "status": "completed", "tag": "1f4eb45a-ea71-4ede-b569-032c9dddfac4"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:45.759314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-2983be45-24ee-4ebb-b6b3-e0ba0eb337cc req-7a72fc2b-6710-47c0-b7a5-cbd2ea66e2d6 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:45.759769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-2983be45-24ee-4ebb-b6b3-e0ba0eb337cc req-7a72fc2b-6710-47c0-b7a5-cbd2ea66e2d6 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:45.771408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-2983be45-24ee-4ebb-b6b3-e0ba0eb337cc req-7a72fc2b-6710-47c0-b7a5-cbd2ea66e2d6 service nova] Creating event network-vif-plugged:1f4eb45a-ea71-4ede-b569-032c9dddfac4 for instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca on hv-cinder-85144 Jul 29 04:49:45.776957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-2983be45-24ee-4ebb-b6b3-e0ba0eb337cc req-7a72fc2b-6710-47c0-b7a5-cbd2ea66e2d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Jul 29 04:49:45.777552 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 204/419] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:49:46.524780 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:46.525408 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:46.532710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:46.533192 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:46.533984 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:46.534427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:46.672997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:46.676496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:46.682096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:46.683596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:46.684723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9323fceb-cb68-4d8e-bf8b-5c9843dd5a9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.164115 Jul 29 04:49:46.685311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 216/420] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:46 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:46.752090 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:46.752896 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:46.759192 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:46.760198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:46.761057 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:46.761748 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:46.907174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:46.914647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-959f9a85-2ce0-44c9-88e5-7ff8d9031396 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.168184 Jul 29 04:49:46.915205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 205/421] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:46 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:47.709705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:47.710246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:47.716218 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:47.716705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:47.717475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:47.717918 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:47.845815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:47.853783 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:47.855299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:47.856403 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ad473298-9cdd-4569-9a7b-29e150964ec8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.150986 Jul 29 04:49:47.856998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 217/422] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:47 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:47.935638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:47.936250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:47.942860 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:47.943313 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:47.944075 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:47.944520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:48.074629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:48.082741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-40d9a0f6-e5e0-46b7-8921-ece8c4516d45 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.150931 Jul 29 04:49:48.083313 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 206/423] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:47 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:48.878680 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:48.879287 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:48.885383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:48.885837 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:48.886591 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:48.887028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:49.018576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:49.026371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:49.027868 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:49.028994 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-59839e8d-8699-40d7-8572-30752987e780 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.154233 Jul 29 04:49:49.029545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 218/424] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:48 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:49.105438 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:49.106232 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:49.113993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:49.114453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:49.115222 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:49.115662 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:49.244231 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:49.251863 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ab62b747-924c-4e02-93fd-89cc956de538 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.150338 Jul 29 04:49:49.252437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 207/425] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:49 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:50.051731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:50.052346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:50.058516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:50.059018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:50.059803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:50.060255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:50.189507 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:50.197630 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:50.199432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:50.200546 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-de26c85d-4cd1-408a-8da6-fbc0cad5dfa4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.152774 Jul 29 04:49:50.201121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 219/426] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:50 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:50.272248 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:50.272880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:50.279956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:50.280482 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:50.282097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:50.282610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:50.415635 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:50.424021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a229658f-aef7-4f0a-a7ee-4a63d82ffac9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.155543 Jul 29 04:49:50.424612 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 208/427] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:50 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:51.223722 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:51.224365 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:51.230634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:51.230960 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:51.231724 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:51.232164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:51.365563 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:51.375065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:51.376551 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:51.377757 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1a661914-c5bf-4cdd-869e-a3bab73c9608 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.157892 Jul 29 04:49:51.378513 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 220/428] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:51 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:51.445388 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:51.446002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:51.457037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:51.457674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:51.458524 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:51.459035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:51.595222 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:51.602713 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e57a9eb9-fc03-4cca-983c-9e983cc86340 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.161258 Jul 29 04:49:51.603282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 209/429] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:51 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:52.401321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:52.401921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:52.407893 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:52.408336 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:52.409262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:52.409703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:52.541416 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:52.550410 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:52.551949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:52.553101 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-dce97eb5-cbec-45ec-937f-351d7b809ea1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.155692 Jul 29 04:49:52.553652 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 221/430] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:52 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:52.623471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:52.624268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:52.631028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:52.631481 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:52.632248 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:52.632714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:52.779416 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:52.789490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cc280957-427b-4a8b-8826-0a43237b9edd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.169771 Jul 29 04:49:52.808406 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 210/431] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:52 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:52.814427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-324447329", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:53.576503 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:53.577441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:53.585025 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:53.586848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:53.587842 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:53.588637 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:53.777052 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:53.786393 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:53.788304 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:53.789646 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0ca5bf4e-b026-43cd-8074-1518012d4216 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.217092 Jul 29 04:49:53.790326 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 211/432] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:53 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:53.811840 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:53.812793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:53.819181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:53.819645 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:53.820672 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:53.821170 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:53.964855 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:53.974005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-18e43e08-5301-4a8c-9cf1-13bc19c84e64 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.166196 Jul 29 04:49:53.974862 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 212/433] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:53 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:54.813980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:54.815560 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:54.822594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:54.823056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:54.823865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:54.824296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:54.976998 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:54.986182 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:54.987976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:54.989300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e8ad5d13-6716-4254-9420-63b0c52dbc2f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.179478 Jul 29 04:49:54.990237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 213/434] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:54 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:54.994758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:54.995325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:55.002218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:55.002471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:55.003242 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:55.003819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:55.149712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:55.158191 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-782ddcd6-8056-4f71-8df2-dc41ed4c777c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1522 microversion: 2.1 time: 0.166781 Jul 29 04:49:55.158708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 214/435] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:54 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:56.013375 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:56.014112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:56.021397 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:56.021930 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:56.023661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:56.024125 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:56.194216 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:56.204947 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:56.206469 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:56.207657 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4a6bba94-c9de-4ab8-8633-2b72550ea162 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1407 microversion: 2.20 time: 0.198613 Jul 29 04:49:56.224212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 215/436] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:56 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:49:56.224212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:56.224212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:56.224212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:56.224728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:56.224728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:56.224728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:56.243693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=100 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:49:56.372136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:56.383938 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3a592a8b-92f2-4778-803a-1abfc9ae13f5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1502 microversion: 2.1 time: 0.173524 Jul 29 04:49:56.385204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 216/437] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:56 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:49:56.406360 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:56.407291 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:56.413557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:56.414009 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:56.414774 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:56.415210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:56.560139 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:56.568996 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ea20bf1b-54f5-47b6-a96d-9d0325cbe054 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1514 microversion: 2.1 time: 0.167015 Jul 29 04:49:56.569581 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 217/438] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:56 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:49:57.232495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:57.233275 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:57.240305 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:57.241439 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:57.242815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:57.243401 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:57.381490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:57.390563 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:57.392148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:57.393376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cea95fe1-daa0-42f6-b014-a21dcaed09b2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1598 microversion: 2.20 time: 0.164755 Jul 29 04:49:57.394006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 218/439] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:49:57 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:49:57.420185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4ba17dbc-affd-4993-8e36-24e2f76ec671 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:57.421001 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4ba17dbc-affd-4993-8e36-24e2f76ec671 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:57.427527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ba17dbc-affd-4993-8e36-24e2f76ec671 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:57.428227 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ba17dbc-affd-4993-8e36-24e2f76ec671 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:57.429057 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ba17dbc-affd-4993-8e36-24e2f76ec671 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:57.429695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ba17dbc-affd-4993-8e36-24e2f76ec671 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:57.524683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4ba17dbc-affd-4993-8e36-24e2f76ec671 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108335 Jul 29 04:49:57.526837 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 219/440] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Jul 29 04:49:57 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:49:58.610298 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-7dd213d4-c996-4771-8185-9a390fdd9abe req-dc6e66f2-6484-496f-a5b0-c826a0633fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630ff067-c10b-4ae9-8d92-c40d206fd0ca", "tag": "1f4eb45a-ea71-4ede-b569-032c9dddfac4"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:58.620746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-7dd213d4-c996-4771-8185-9a390fdd9abe req-dc6e66f2-6484-496f-a5b0-c826a0633fd5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:58.621574 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-7dd213d4-c996-4771-8185-9a390fdd9abe req-dc6e66f2-6484-496f-a5b0-c826a0633fd5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:58.636132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-7dd213d4-c996-4771-8185-9a390fdd9abe req-dc6e66f2-6484-496f-a5b0-c826a0633fd5 service nova] Creating event network-changed:1f4eb45a-ea71-4ede-b569-032c9dddfac4 for instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca on hv-cinder-85144 Jul 29 04:49:58.642136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-7dd213d4-c996-4771-8185-9a390fdd9abe req-dc6e66f2-6484-496f-a5b0-c826a0633fd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036403 Jul 29 04:49:58.647019 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 220/441] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:49:59.260166 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:49:59.262897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:59.271641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:59.272448 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:59.273484 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:59.274141 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:59.304353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lazy-loading 'flavor' on Instance uuid 052579df-c255-4129-911a-8a4dda7e6ced {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:49:59.449847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f5a3ed73-f20d-4a0a-80a2-abfa6f3c90fa tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced/action" status: 200 len: 32 microversion: 2.1 time: 0.194309 Jul 29 04:49:59.466416 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 221/442] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:49:59 2022] POST /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 04:49:59.493484 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:49:59.496804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:49:59.512147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:59.512696 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:59.513505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:49:59.513961 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:49:59.731353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:49:59.742641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f13a4f60-c9a1-420a-9827-595a22a7e147 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.268012 Jul 29 04:49:59.743822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 222/443] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:49:59 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:00.763576 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:00.764340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:00.771202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:00.771663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:00.772455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:00.773159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:00.925661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:00.933806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ed5c35f2-b083-4234-820f-37b7834f852b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.174191 Jul 29 04:50:00.934381 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 223/444] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:00 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:01.956357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:01.957859 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:01.964741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:01.965423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:01.966226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:01.966672 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:02.121550 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:02.130582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a845b204-7db2-4555-b3b0-ffaba4d1e133 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.179461 Jul 29 04:50:02.131209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 224/445] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:01 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:02.546115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=30 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:02.827020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=14 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:03.153563 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:03.154297 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:03.162301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:03.162869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:03.163710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:03.164271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:03.313915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:03.322751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f0494ce0-fca5-4cdd-a4ec-c5cc5925c8d3 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.173308 Jul 29 04:50:03.323957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 225/446] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:03 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:04.315924 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] validate_networks() for None {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:50:04.345763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:04.346394 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:04.353568 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:04.354507 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:04.355550 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:04.356187 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:04.516032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:04.524303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-46040002-916d-4f68-98b7-9aaf36f0e52b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.184753 Jul 29 04:50:04.537869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 226/447] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:04 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:04.618514 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:50:04.618970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:50:04.619793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:50:04.620384 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:50:04.620977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:50:04.630280 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:04.631153 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:04.632050 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:04.632491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:04.651467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Getting quotas for project 48e14495c8f7484ab3adc511e812d3e8. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:50:04.656238 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Getting quotas for user e758990a520b45a0b5c294972f0dd37a and project 48e14495c8f7484ab3adc511e812d3e8. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:50:04.668032 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:50:04.671460 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:50:04.724923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c9e38116-d72a-4b4b-8084-0ffec2da2015 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.914503 Jul 29 04:50:04.731919 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 222/448] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 11922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:50:04.737429 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-dc8cf8bb-76e7-42c1-aceb-238dbaf76720 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:04.738051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-dc8cf8bb-76e7-42c1-aceb-238dbaf76720 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:04.798499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-dc8cf8bb-76e7-42c1-aceb-238dbaf76720 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:04.806319 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-dc8cf8bb-76e7-42c1-aceb-238dbaf76720 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1214 microversion: 2.1 time: 0.073305 Jul 29 04:50:04.807236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 227/449] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:04 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:05.549492 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:05.550118 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:05.566957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:05.567447 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:05.568306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:05.568891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:05.723847 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:05.732014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-515525ca-e212-4650-83aa-40d748cae3cc tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.189124 Jul 29 04:50:05.732590 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 223/450] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:05 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:05.830390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:05.832082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:05.840392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:05.841180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:05.842382 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:05.843197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:05.924754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:05.935022 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6b7234bd-ed8f-47f5-bd48-a2e2c72656da tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1266 microversion: 2.1 time: 0.109695 Jul 29 04:50:05.935813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 228/451] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:05 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:06.756635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:06.757351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:06.768675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:06.769409 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:06.770554 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:06.771192 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:06.960454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:06.962794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:06.963878 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:06.971538 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f3be0e4a-ca05-478c-abce-0ab72d37c9f1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.219066 Jul 29 04:50:06.972203 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 224/452] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:06 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:06.993835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:06.994305 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:06.995108 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:06.995559 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:07.139148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:07.146825 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d86f1214-c5f3-490b-a56b-41111984bd65 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.191114 Jul 29 04:50:07.147716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 229/453] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:06 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:07.897811 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-709f4539-fb39-4129-8d17-a2d4636c9a38 req-43660f28-3648-40f3-ad42-5b79b03f9574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24eb9fdb-25e8-4c3b-846f-be1ce270af6b", "tag": "06c552fb-5924-421e-99ec-66f6efcee541"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:07.929762 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-709f4539-fb39-4129-8d17-a2d4636c9a38 req-43660f28-3648-40f3-ad42-5b79b03f9574 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:07.930897 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-709f4539-fb39-4129-8d17-a2d4636c9a38 req-43660f28-3648-40f3-ad42-5b79b03f9574 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:07.965262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-709f4539-fb39-4129-8d17-a2d4636c9a38 req-43660f28-3648-40f3-ad42-5b79b03f9574 service nova] Creating event network-changed:06c552fb-5924-421e-99ec-66f6efcee541 for instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b on hv-cinder-85144 Jul 29 04:50:07.989323 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-709f4539-fb39-4129-8d17-a2d4636c9a38 req-43660f28-3648-40f3-ad42-5b79b03f9574 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092696 Jul 29 04:50:07.993622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 225/454] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:50:07.994136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:07.994754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:08.009513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:08.009962 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:08.012631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:08.013767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:08.169885 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:08.172237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:08.180564 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:08.181886 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:08.182895 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:08.183566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:08.226995 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:08.236890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-293bed6c-c5b3-40b2-8344-aac298d854fb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.246590 Jul 29 04:50:08.239385 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 230/455] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:07 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:08.432271 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:08.446850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d5c2e212-4779-4558-a6fd-e785b58526a3 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.281880 Jul 29 04:50:08.448089 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 226/456] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:08 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:09.263702 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:09.265797 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:09.271807 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:09.272530 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:09.273705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:09.274374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:09.446515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:09.457152 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ea0005dc-58fb-438f-8f07-1ab77bcec957 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.197102 Jul 29 04:50:09.458035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 231/457] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:09 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:09.471298 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:09.472759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:09.479066 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:09.479733 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:09.480818 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:09.481329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:09.628925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:09.636964 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-73541f5b-86d5-477d-b649-b8e5e3cc6748 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.171243 Jul 29 04:50:09.637541 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 227/458] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:09 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:10.496987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:10.497540 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:10.504268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:10.507577 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:10.508650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:10.509279 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:10.666517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:10.667730 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:10.674777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:10.675478 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:10.676434 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:10.676898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:10.703610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:10.711274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-58430bf1-7254-49af-8957-bbc5304797bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.218234 Jul 29 04:50:10.712090 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 232/459] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:10 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:10.820860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:10.829077 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c290e633-3797-41f3-8323-6a5a21124320 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.173409 Jul 29 04:50:10.843149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 228/460] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:10 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:11.736178 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:11.736814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:11.743707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:11.744165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:11.744984 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:11.745432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:11.750946 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:11.852940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:11.853634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:11.864373 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:11.865113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:11.866043 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:11.866625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:11.934911 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:11.947573 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-27af0b18-37bc-4a9b-84d1-840865350f9a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.215722 Jul 29 04:50:11.948291 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 233/461] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:11 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:12.048572 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:12.056775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-dc47d74b-76e5-4766-8b18-836ec36c5d1d tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.210290 Jul 29 04:50:12.057878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 229/462] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:11 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:12.971787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:12.972397 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:12.978817 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:12.979264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:12.980022 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:12.980458 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:13.078681 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:13.079288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:13.085241 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:13.085684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:13.086443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:13.086874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:13.111083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:13.118411 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2ea09b52-dd73-43f8-958b-c79cf2e9b4c8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.150537 Jul 29 04:50:13.118971 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 234/463] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:12 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:13.214977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:13.223316 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d7091cfc-e7ff-4b1b-a5d1-d8f888aa675b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.148660 Jul 29 04:50:13.223885 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 230/464] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:13 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:14.139978 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:14.141567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:14.144065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=74 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:14.149925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:14.150378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:14.151206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:14.151640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:14.243243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:14.243857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:14.251292 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:14.251952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:14.252775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:14.253211 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:14.284631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:14.292214 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-88c97919-79cf-4a29-8a5f-69b5d314e185 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.156489 Jul 29 04:50:14.292820 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 235/465] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:14 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:14.483842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:14.491926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b9146db4-2393-489d-9092-5ddddee5eb9c tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.252544 Jul 29 04:50:14.492496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 231/466] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:14 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:15.315857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:15.316494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:15.318376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:15.325947 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:15.326982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:15.327951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:15.328396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:15.465078 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:15.473207 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-60959b48-63b1-43bd-ae4f-6b854c264741 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.161206 Jul 29 04:50:15.473784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 236/467] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:15 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:15.513719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:15.514417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:15.516459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:15.517318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:15.524352 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:15.524942 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:15.525715 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:15.526264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:15.749243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:15.759166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9b7024fe-727d-4472-845b-d19bfaf415fa tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.249249 Jul 29 04:50:15.760074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 232/468] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:15 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:16.495074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:16.495684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:16.502342 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:16.502786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:16.503547 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:16.503984 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:16.641264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:16.650601 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-196fd982-f802-4b96-9cfa-106de24247e8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.159319 Jul 29 04:50:16.651873 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 237/469] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:16 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:16.780566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:16.781206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:16.787452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:16.787896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:16.788689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:16.789125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:16.923332 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:16.930956 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3dd68c63-8ae0-4376-a56a-83eafd321d86 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.155619 Jul 29 04:50:16.931623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 233/470] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:16 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:17.673095 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:17.673714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:17.680137 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:17.680594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:17.681390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:17.681835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:17.814189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:17.821671 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1a4b810c-8c0c-4108-b019-6be8618df6e4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.153347 Jul 29 04:50:17.822238 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 238/471] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:17 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:17.953992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:17.955054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:17.961168 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:17.961619 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:17.962387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:17.962828 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:18.095746 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:18.103207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a91d100f-02b5-404a-b0dd-72c7fc577597 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.154215 Jul 29 04:50:18.103779 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 234/472] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:17 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:18.147165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-a6289b65-bf9c-4330-b423-781022be3989 req-e270894a-be9b-4511-993a-d250a9ba9b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24eb9fdb-25e8-4c3b-846f-be1ce270af6b", "name": "network-vif-plugged", "status": "completed", "tag": "06c552fb-5924-421e-99ec-66f6efcee541"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:18.156991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-a6289b65-bf9c-4330-b423-781022be3989 req-e270894a-be9b-4511-993a-d250a9ba9b36 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:18.157447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-a6289b65-bf9c-4330-b423-781022be3989 req-e270894a-be9b-4511-993a-d250a9ba9b36 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:18.169603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-a6289b65-bf9c-4330-b423-781022be3989 req-e270894a-be9b-4511-993a-d250a9ba9b36 service nova] Creating event network-vif-plugged:06c552fb-5924-421e-99ec-66f6efcee541 for instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b on hv-cinder-85144 Jul 29 04:50:18.174712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-a6289b65-bf9c-4330-b423-781022be3989 req-e270894a-be9b-4511-993a-d250a9ba9b36 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 Jul 29 04:50:18.175352 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 239/473] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:50:18.845258 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:18.845877 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:18.852451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:18.852940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:18.853720 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:18.854267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:19.009797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:19.018076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-84d81442-8e35-41b9-9bbc-b0e2d6962002 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.178285 Jul 29 04:50:19.018644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 235/474] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:18 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:19.125629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:19.126351 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:19.133147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:19.133648 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:19.134388 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:19.134789 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:19.282040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:19.289639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7ede12f9-a321-4700-8cd1-76eea84f077b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.168235 Jul 29 04:50:19.290198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 240/475] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:19 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:20.040406 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:20.041032 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:20.047995 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:20.048451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:20.049256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:20.049698 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:20.249849 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:20.257458 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3d539c84-d7a3-4307-b614-800141b20abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.220989 Jul 29 04:50:20.258052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 236/476] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:20 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:20.310683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:20.311896 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:20.318429 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:20.318883 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:20.319661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:20.320102 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:20.449737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:20.457737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-07cd2113-1f11-4649-8b4d-5e3997a8214f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1314 microversion: 2.1 time: 0.150919 Jul 29 04:50:20.458306 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 241/477] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:20 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:21.278920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:21.279452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:21.286114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.286114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.286776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.287191 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.421587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:21.430401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f5094ad3-0dc4-4c0f-a2d4-02fdb0de3c22 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.155428 Jul 29 04:50:21.431241 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 237/478] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:21 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:21.478865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:21.479499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:21.487050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.487525 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.488317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.488835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.622200 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:21.630234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-370b31a3-5b6a-4547-a4e5-e6b236439977 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1463 microversion: 2.1 time: 0.155233 Jul 29 04:50:21.630794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 242/479] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:21 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:21.675592 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:21.676095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:21.682123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.682580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.683344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.683784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.708589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Going to try to terminate instance {{(pid=129684) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:50:21.741482 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:21.785502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-64b3a5e1-d544-4472-831b-1e82e5e65219 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "DELETE /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 204 len: 0 microversion: 2.1 time: 0.113475 Jul 29 04:50:21.786115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 238/480] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:50:21 2022] DELETE /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:50:21.794062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:21.797150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:21.808497 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.809493 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.812495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:21.813041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:21.972935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:21.980827 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-59d0d56c-9447-4402-a63c-4eb032885759 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1469 microversion: 2.1 time: 0.190495 Jul 29 04:50:21.981408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 243/481] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:21 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:22.454586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:22.455205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:22.461208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:22.461653 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:22.462397 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:22.462833 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:22.596260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:22.603693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4f73e894-599f-4439-bd38-74828527cd12 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.153979 Jul 29 04:50:22.604263 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 239/482] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:22 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:23.006088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:23.006697 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:23.015100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:23.015739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:23.016564 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:23.017079 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:23.156490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:23.164590 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2da0efa5-507f-4567-89a3-b6ed5dbc12e0 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1469 microversion: 2.1 time: 0.162416 Jul 29 04:50:23.165397 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 244/483] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:22 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:23.626256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:23.626861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:23.633068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:23.633515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:23.634285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:23.634723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:23.767646 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:23.775202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8d221ea8-5801-491d-b986-cce9bad004d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.153323 Jul 29 04:50:23.775805 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 240/484] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:23 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:50:24.187281 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:24.188085 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:24.195018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:24.195551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:24.196334 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:24.196815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:24.355967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:24.365786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-823b26ea-e3d9-4da5-996f-41c4c40d531b tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1469 microversion: 2.1 time: 0.183498 Jul 29 04:50:24.366456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 245/485] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:24 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:24.796776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:24.797446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:24.805032 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:24.805535 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:24.808785 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:24.808785 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:24.959832 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:24.969721 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1b58b005-364c-472d-a00e-5fdc6da16716 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.177141 Jul 29 04:50:24.971579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 241/486] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:24 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:25.388296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:25.390258 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:25.399095 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:25.400070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:25.407331 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:25.407922 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:25.581538 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:25.589432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4ed33db6-9e78-4d6a-a3a5-e03360f93cfd tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1469 microversion: 2.1 time: 0.205050 Jul 29 04:50:25.590037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 246/487] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:25 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:25.747588 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-856ee2e8-da67-41d8-ab2b-86c73888d9c4 req-0aa893c1-0a72-4064-8751-cd3b8c2820b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24eb9fdb-25e8-4c3b-846f-be1ce270af6b", "name": "network-vif-deleted", "tag": "06c552fb-5924-421e-99ec-66f6efcee541"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:25.758959 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-856ee2e8-da67-41d8-ab2b-86c73888d9c4 req-0aa893c1-0a72-4064-8751-cd3b8c2820b5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:25.759409 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-856ee2e8-da67-41d8-ab2b-86c73888d9c4 req-0aa893c1-0a72-4064-8751-cd3b8c2820b5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:25.772107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-856ee2e8-da67-41d8-ab2b-86c73888d9c4 req-0aa893c1-0a72-4064-8751-cd3b8c2820b5 service nova] Creating event network-vif-deleted:06c552fb-5924-421e-99ec-66f6efcee541 for instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b on hv-cinder-85144 Jul 29 04:50:25.777390 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-856ee2e8-da67-41d8-ab2b-86c73888d9c4 req-0aa893c1-0a72-4064-8751-cd3b8c2820b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033651 Jul 29 04:50:25.778477 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 242/488] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:50:25.993180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:25.993812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:26.001120 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:26.001575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:26.002566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:26.003020 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:26.143753 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:26.151277 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-11c25c00-c35f-4b69-890b-7784821261f8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.162349 Jul 29 04:50:26.151843 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 247/489] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:25 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:26.612208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:26.613082 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:26.619690 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:26.620147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:26.620948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:26.621394 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:26.652182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:26.652937 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:26.653585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lazy-loading 'fault' on Instance uuid 24eb9fdb-25e8-4c3b-846f-be1ce270af6b {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:50:26.699588 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:26.707699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-54149333-5dc1-42cd-9b93-09c331713a5f tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1304 microversion: 2.1 time: 0.100248 Jul 29 04:50:26.708264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 243/490] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:26 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:27.173300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:27.173839 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:27.180363 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.180862 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.181707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.182199 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.318942 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:27.328988 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-25698a5c-4be1-4464-9718-12263799bec1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1500 microversion: 2.1 time: 0.160277 Jul 29 04:50:27.329692 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 248/491] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:27 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:27.350645 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51e11bac-8f93-4c5e-9840-4b02f76d12cb"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:27.353054 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:27.359884 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.360396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.361192 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.361636 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.383913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] HTTP exception thrown: Cannot 'attach_volume' instance 052579df-c255-4129-911a-8a4dda7e6ced while it is in vm_state rescued Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Request method failure captured: Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: POST /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced/os-volume_attachments HTTP/1.1 Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 74 Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZhlNNaO7HnMZzvgbxie8U5RKqqwvq_Bq6GMJi5VZh7oiuxTWcZp_kC9HxflMzmzIMuMvOP9TRm4TMboTmNgulYrkVZgRQLQCFy247oo2-KsOMTwWtV0ThTLvBHwpFQbue4zcZdxDvH6Tsa_H2roUzECLDDqCk-Yda_F3VRh8ODwP8 Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:50:27.385859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 5f9d45265c6f47609f9f8abcf3526ff0 Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {"volumeAttachment": {"volumeId": "51e11bac-8f93-4c5e-9840-4b02f76d12cb"}} Jul 29 04:50:27.387404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Cannot 'attach_volume' instance 052579df-c255-4129-911a-8a4dda7e6ced while it is in vm_state rescued Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'server_id': '052579df-c255-4129-911a-8a4dda7e6ced', 'body': {'volumeAttachment': {'volumeId': '51e11bac-8f93-4c5e-9840-4b02f76d12cb'}}} Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 052579df-c255-4129-911a-8a4dda7e6ced in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:50:27.388207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 052579df-c255-4129-911a-8a4dda7e6ced while it is in vm_state rescued Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:50:27.389432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:50:27.390603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:50:27.390603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:50:27.390603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 052579df-c255-4129-911a-8a4dda7e6ced while it is in vm_state rescued Jul 29 04:50:27.390603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:50:27.390603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Returning 409 to user: Cannot 'attach_volume' instance 052579df-c255-4129-911a-8a4dda7e6ced while it is in vm_state rescued {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:50:27.390603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d4a6a892-09b4-416c-8d25-beda0eed1633 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040653 Jul 29 04:50:27.390603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 244/492] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:50:27 2022] POST /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 04:50:27.396655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-636530d5-f7d3-4be9-adf9-5b9c20662200 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:27.397203 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-636530d5-f7d3-4be9-adf9-5b9c20662200 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:27.403163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-636530d5-f7d3-4be9-adf9-5b9c20662200 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.403626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-636530d5-f7d3-4be9-adf9-5b9c20662200 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.404397 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-636530d5-f7d3-4be9-adf9-5b9c20662200 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.405517 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-636530d5-f7d3-4be9-adf9-5b9c20662200 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.451177 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:27.471254 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-636530d5-f7d3-4be9-adf9-5b9c20662200 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced/action" status: 202 len: 0 microversion: 2.1 time: 0.078358 Jul 29 04:50:27.474703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 249/493] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:50:27 2022] POST /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:50:27.479950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:27.480594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:27.486854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.487304 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.488065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.488505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.622397 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:27.630181 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3da911dc-5f10-41ef-bc60-81ceaff1f443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1508 microversion: 2.1 time: 0.154025 Jul 29 04:50:27.630744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 245/494] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:27 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:27.729479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:27.730106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:27.736560 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.737044 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.737799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.738236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.772618 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:27.773190 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:27.773802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lazy-loading 'fault' on Instance uuid 24eb9fdb-25e8-4c3b-846f-be1ce270af6b {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:50:27.818257 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e758990a520b45a0b5c294972f0dd37a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14495c8f7484ab3adc511e812d3e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:27.825730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-59ab54d6-28be-4ed2-9624-84b238490277 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 200 len: 1304 microversion: 2.1 time: 0.100543 Jul 29 04:50:27.826296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 250/495] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:27 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:28.651776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:28.652300 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:28.658259 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:28.658725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:28.659826 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:28.660277 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:28.785565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:28.792996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-74ee2032-a84f-4697-81a0-367f411ae618 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1508 microversion: 2.1 time: 0.145587 Jul 29 04:50:28.793560 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 246/496] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:28 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:28.847877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:28.848680 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] [instance: 24eb9fdb-25e8-4c3b-846f-be1ce270af6b] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:28.855263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:28.855722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:28.856494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:28.856966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:28.871683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] HTTP exception thrown: Instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b could not be found. Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Request method failure captured: Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b HTTP/1.1 Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42brGtVN3Cx3xAuPygG8xFiV4NK3dz0Sw_9h4I4KaUH0vB2RH_ANHmD_cMuDx5GlXsXQ66fhOwGkF60DGo2_aXJAokUxFaltBZ0tFjsiOrw1JgJOI3rC_kZ2hD8XhUsNNSUNuLKEoSHYwPbGC4wxo1S736386mFbf6kNiUC0ipktXNw Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 48e14495c8f7484ab3adc511e812d3e8 Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-VolumesNegativeTest-636718816 Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:50:28.873522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48e14495c8f7484ab3adc511e812d3e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48e14495c8f7484ab3adc511e812d3e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48e14495c8f7484ab3adc511e812d3e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48e14495c8f7484ab3adc511e812d3e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-VolumesNegativeTest-636718816 Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 48e14495c8f7484ab3adc511e812d3e8 Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-VolumesNegativeTest-636718816 Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-VolumesNegativeTest-636718816-project Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: e758990a520b45a0b5c294972f0dd37a Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-VolumesNegativeTest-636718816-project Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b could not be found. Jul 29 04:50:28.875159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '24eb9fdb-25e8-4c3b-846f-be1ce270af6b'} Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b could not be found. Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:50:28.876005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b could not be found. Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b could not be found. Jul 29 04:50:28.877409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:50:28.878669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] Returning 404 to user: Instance 24eb9fdb-25e8-4c3b-846f-be1ce270af6b could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:50:28.878669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ba4ce840-93c3-4e7d-b481-812e46d45726 tempest-VolumesNegativeTest-636718816 tempest-VolumesNegativeTest-636718816-project] 10.222.0.40 "GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b" status: 404 len: 111 microversion: 2.1 time: 0.030997 Jul 29 04:50:28.878669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 251/497] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:28 2022] GET /compute/v2.1/servers/24eb9fdb-25e8-4c3b-846f-be1ce270af6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:50:29.816743 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:29.817481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:29.824242 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:29.824774 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:29.825811 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:29.826326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:29.973756 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:29.981133 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d6643836-445a-430a-8645-659d429ae17f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1508 microversion: 2.1 time: 0.169807 Jul 29 04:50:29.981696 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 247/498] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:29 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:31.008174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:31.009755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:31.019213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:31.019676 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:31.020663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:31.021269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:31.189028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:31.197766 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3a5fa02a-c322-402a-a7e6-ffa23922e603 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1508 microversion: 2.1 time: 0.194230 Jul 29 04:50:31.198325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 252/499] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:31 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:32.219906 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:32.220522 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:32.227256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:32.227720 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:32.228532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:32.229030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:32.382914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:32.391450 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b7b3bc1d-a3c7-40f2-ac29-43603acf5e42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1514 microversion: 2.1 time: 0.176014 Jul 29 04:50:32.392001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 248/500] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:32 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:34.796652 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-76b23d35-3384-4cf7-910d-f32ec781b59c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'create', calling method: .version_select at 0x7f3c545b5dc0>, body: {"keypair": {"name": "tempest-keypair-1004759515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8J/uOQ5PaW5czNiSnJmMxajYcd0CuZZZu5jKAQPH8ogtbECq+4/Qz7SMflAXdow4J/8g9Ga8e4xc0jxkfltfWi6xGjA/FxjMZqqRKL9hX7k7pra4JXhGgywrkwxGPc1g=="}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:34.813821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-76b23d35-3384-4cf7-910d-f32ec781b59c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:50:34.817755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-76b23d35-3384-4cf7-910d-f32ec781b59c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for user 5f9d45265c6f47609f9f8abcf3526ff0 and project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:50:34.829667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76b23d35-3384-4cf7-910d-f32ec781b59c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [65862f0a-abe2-45e8-890b-366dfc938a72] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 04:50:35.836236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [None req-76b23d35-3384-4cf7-910d-f32ec781b59c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [65862f0a-abe2-45e8-890b-366dfc938a72] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 47196. Jul 29 04:50:35.851412 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-76b23d35-3384-4cf7-910d-f32ec781b59c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.060110 Jul 29 04:50:35.852101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 253/501] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:50:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:50:37.333118 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1561246079", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e84cf4e-559b-4bbd-af56-3f6353c004d0"}], "security_groups": [{"name": "tempest-securitygroup--903590613"}], "key_name": "tempest-keypair-1004759515", "user_data": "}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:37.341457 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:37.438423 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] validate_networks() for [('3e84cf4e-559b-4bbd-af56-3f6353c004d0', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:50:37.803967 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:50:37.804393 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:50:37.804898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:50:37.805310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:50:37.805726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:50:37.814528 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:37.814977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:37.815797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:37.816256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:37.834552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:50:37.838377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Getting quotas for user 5f9d45265c6f47609f9f8abcf3526ff0 and project 0f6c1ad3422c40d4af4ef5329ecd9d86. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:50:37.849890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:50:37.852135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:50:37.898107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-beaab9b0-8e02-4225-b41a-01490171439d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.570067 Jul 29 04:50:37.898760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 249/502] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:50:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:50:37.914303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c868bf62-ffca-4fc3-8edb-37ac3af857e1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:37.914886 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c868bf62-ffca-4fc3-8edb-37ac3af857e1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:37.972779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c868bf62-ffca-4fc3-8edb-37ac3af857e1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:37.979400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c868bf62-ffca-4fc3-8edb-37ac3af857e1 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1246 microversion: 2.1 time: 0.070297 Jul 29 04:50:37.979963 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 254/503] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:37 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:39.000619 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:39.001244 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:39.007692 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:39.008141 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:39.008934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:39.009368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:39.071105 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:39.078517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1688d9d1-1281-45ae-90fe-0d5c88a9a418 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1250 microversion: 2.1 time: 0.081866 Jul 29 04:50:39.079068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 250/504] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:38 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:40.099094 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:40.099706 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:40.106171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:40.106619 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:40.107400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:40.107972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:40.171382 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:40.178909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-aabf0aca-fc29-4739-bd3a-41725869d7d4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1304 microversion: 2.1 time: 0.083759 Jul 29 04:50:40.179480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 255/505] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:40 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:41.205576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:41.206898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:41.214621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:41.215177 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:41.216056 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:41.216648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:41.419693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:41.427859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c84b4181-258b-48af-8941-66d9b77fcdf2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.229609 Jul 29 04:50:41.428781 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 251/506] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:41 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:41.477176 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-ac5bef0a-fb7b-493f-a3a9-83b5352550d2 req-7aff5567-9521-4f70-aab9-d3f9b546d414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f027c23f-8c17-419b-80a0-bdb62b416da3", "tag": "aee6ef22-26d9-4a6a-b997-015edcbf797e"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:41.491639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ac5bef0a-fb7b-493f-a3a9-83b5352550d2 req-7aff5567-9521-4f70-aab9-d3f9b546d414 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:41.492344 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ac5bef0a-fb7b-493f-a3a9-83b5352550d2 req-7aff5567-9521-4f70-aab9-d3f9b546d414 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:41.505596 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-ac5bef0a-fb7b-493f-a3a9-83b5352550d2 req-7aff5567-9521-4f70-aab9-d3f9b546d414 service nova] Creating event network-changed:aee6ef22-26d9-4a6a-b997-015edcbf797e for instance f027c23f-8c17-419b-80a0-bdb62b416da3 on hv-cinder-85144 Jul 29 04:50:41.511274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-ac5bef0a-fb7b-493f-a3a9-83b5352550d2 req-7aff5567-9521-4f70-aab9-d3f9b546d414 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047674 Jul 29 04:50:41.512104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 256/507] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:50:42.452510 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:42.453436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:42.462396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:42.462825 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:42.463572 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:42.464052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:42.597383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:42.604822 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fc2b1f34-93de-4e7d-a9a8-78223550b34d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.158699 Jul 29 04:50:42.605394 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 252/508] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:42 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:43.625958 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:43.626847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:43.633074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:43.633536 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:43.634315 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:43.634763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:43.851602 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:43.860278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4d8cf90c-286a-43aa-a44e-4f105286a964 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.238942 Jul 29 04:50:43.861100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 257/509] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:43 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:44.882341 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:44.883316 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:44.889878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:44.890331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:44.891306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:44.891750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:45.098090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:45.111415 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2cc1cfb2-849a-44d4-830a-7e04ca5250a5 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.233356 Jul 29 04:50:45.112661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 253/510] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:44 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:46.132276 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:46.132959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:46.139904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:46.141623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:46.142273 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:46.143217 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:46.143810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:46.307027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:46.319029 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4a83a818-746a-431d-a3e1-d06d6424935a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.190744 Jul 29 04:50:46.334222 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 258/511] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:46 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:47.342377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:47.343162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:47.359147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:47.359892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:47.361417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:47.362031 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:47.597249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:47.606371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c0cbd153-f637-460d-9b57-ee148646bcfd tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.268155 Jul 29 04:50:47.607504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 254/512] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:47 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:48.623965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-19e14719-c662-4bd7-abbc-4230870ac499 req-da0945c0-b1a0-4022-ae56-4e98cf5b3bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f027c23f-8c17-419b-80a0-bdb62b416da3", "name": "network-vif-plugged", "status": "completed", "tag": "aee6ef22-26d9-4a6a-b997-015edcbf797e"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:48.630424 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:48.631167 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:48.635915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:48.636524 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:48.642715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:48.646781 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:48.647318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:48.648156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:48.648617 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:48.659495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-19e14719-c662-4bd7-abbc-4230870ac499 req-da0945c0-b1a0-4022-ae56-4e98cf5b3bd3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:48.660355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-19e14719-c662-4bd7-abbc-4230870ac499 req-da0945c0-b1a0-4022-ae56-4e98cf5b3bd3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:48.697907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-19e14719-c662-4bd7-abbc-4230870ac499 req-da0945c0-b1a0-4022-ae56-4e98cf5b3bd3 service nova] Creating event network-vif-plugged:aee6ef22-26d9-4a6a-b997-015edcbf797e for instance f027c23f-8c17-419b-80a0-bdb62b416da3 on hv-cinder-85144 Jul 29 04:50:48.713102 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-19e14719-c662-4bd7-abbc-4230870ac499 req-da0945c0-b1a0-4022-ae56-4e98cf5b3bd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092604 Jul 29 04:50:48.714060 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 259/513] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:50:49.208061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:49.231717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6cad155d-b556-41b6-8f79-43d53f652810 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.601442 Jul 29 04:50:49.233206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 255/514] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:48 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:50.259848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:50.261262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:50.270785 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:50.271505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:50.272532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:50.273240 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:50.547230 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:50.563368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f9d43c3c-067e-4562-9ecd-7906217a7bf8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.307528 Jul 29 04:50:50.564790 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 260/515] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:50 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:51.586330 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:51.587637 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:51.602610 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:51.606287 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:51.610413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:51.613137 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:51.626275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:50:51.637292 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 04:50:51.637864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 04:50:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 04:50:52.244240 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:52.253721 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e4a0a501-f8a7-48ef-97a5-b346fcce303b tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1371 microversion: 2.1 time: 0.672488 Jul 29 04:50:52.268485 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 256/516] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:51 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1371 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:53.275984 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:53.277040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:53.285863 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:53.286694 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:53.287976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:53.288804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:53.446374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:50:53.465890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-09ac35bc-bb4f-4ee2-aece-e1219ffb76d0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1565 microversion: 2.1 time: 0.194990 Jul 29 04:50:53.466722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 261/517] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:50:53 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:50:53.490165 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-90467609-8d56-4bfa-8d69-6045a724078d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:50:53.490680 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-90467609-8d56-4bfa-8d69-6045a724078d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:50:53.496974 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90467609-8d56-4bfa-8d69-6045a724078d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:53.498300 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90467609-8d56-4bfa-8d69-6045a724078d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:53.499443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90467609-8d56-4bfa-8d69-6045a724078d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:53.500081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-90467609-8d56-4bfa-8d69-6045a724078d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:53.629147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-90467609-8d56-4bfa-8d69-6045a724078d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144375 Jul 29 04:50:53.629742 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 257/518] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:50:53 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:50:54.786488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-ac0f28a3-caea-4d1a-a2cd-5ea33e3234cf req-64dd8904-7b96-4645-b0cc-d50ab707803e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f027c23f-8c17-419b-80a0-bdb62b416da3", "tag": "aee6ef22-26d9-4a6a-b997-015edcbf797e"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:50:54.798803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ac0f28a3-caea-4d1a-a2cd-5ea33e3234cf req-64dd8904-7b96-4645-b0cc-d50ab707803e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:50:54.799322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ac0f28a3-caea-4d1a-a2cd-5ea33e3234cf req-64dd8904-7b96-4645-b0cc-d50ab707803e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:50:54.835810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-ac0f28a3-caea-4d1a-a2cd-5ea33e3234cf req-64dd8904-7b96-4645-b0cc-d50ab707803e service nova] Creating event network-changed:aee6ef22-26d9-4a6a-b997-015edcbf797e for instance f027c23f-8c17-419b-80a0-bdb62b416da3 on hv-cinder-85144 Jul 29 04:50:54.844341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-ac0f28a3-caea-4d1a-a2cd-5ea33e3234cf req-64dd8904-7b96-4645-b0cc-d50ab707803e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058821 Jul 29 04:50:54.845008 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 262/519] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:03.681888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:03.682642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=8 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:03.687272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-79a02e6c-95af-4097-af2b-b80babaa4c67 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Action: 'create', calling method: .version_select at 0x7f3c544a94c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-884405679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZHMDZxvlKRS01+ak+Rw2DjHd2020NrwNGPXwhS2DgEC3kwVGXrC/3qmNLNg/YnokCHzoihQR9l+vEcqZy/PN4vXOEocPQ3Pgr4wyO0qu12iSwhKCE6t6isB6oaS6VmTw=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:03.704966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-79a02e6c-95af-4097-af2b-b80babaa4c67 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Getting quotas for project 21c0f0b9063948a9a0183b528bc21130. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:51:03.708876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-79a02e6c-95af-4097-af2b-b80babaa4c67 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Getting quotas for user 11f44b37b46b4793944285bee7b8427e and project 21c0f0b9063948a9a0183b528bc21130. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:51:03.730526 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-79a02e6c-95af-4097-af2b-b80babaa4c67 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049482 Jul 29 04:51:03.731172 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 258/520] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:51:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:03.781478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-460895678", "imageRef": "91c283cc-3741-469a-bab0-491b86f6a7bf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-884405679", "networks": [{"uuid": "4ba73cc7-e7ec-4057-be46-46395fa10f6a"}]}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:03.835377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] validate_networks() for [('4ba73cc7-e7ec-4057-be46-46395fa10f6a', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:51:04.201550 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:51:04.201982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:51:04.202462 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:51:04.202881 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:51:04.203299 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:51:04.212262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:04.212746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:04.213559 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:04.214006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:04.220807 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:04.233623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Getting quotas for project 21c0f0b9063948a9a0183b528bc21130. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:51:04.237642 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Getting quotas for user 11f44b37b46b4793944285bee7b8427e and project 21c0f0b9063948a9a0183b528bc21130. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:51:04.249269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:51:04.251532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91c283cc-3741-469a-bab0-491b86f6a7bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:51:04.298813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b73c8f0a-0e79-487e-95c8-f2958f817fb1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522743 Jul 29 04:51:04.299460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 263/521] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:51:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:51:04.310922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-607e9622-733e-424c-b886-a2db1de336aa tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:04.311568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-607e9622-733e-424c-b886-a2db1de336aa tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:04.383239 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-607e9622-733e-424c-b886-a2db1de336aa tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:04.392559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-607e9622-733e-424c-b886-a2db1de336aa tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1257 microversion: 2.1 time: 0.086090 Jul 29 04:51:04.393270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 259/522] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:04 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1257 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:51:05.418280 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:05.420343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:05.426977 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:05.427434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:05.428209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:05.428676 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:05.498746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:05.507869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6e4f4de2-b07a-4dd7-bc04-ef18ce5f5864 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1317 microversion: 2.1 time: 0.093952 Jul 29 04:51:05.508649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 264/523] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:05 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1317 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:06.529494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:06.530115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:06.537023 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:06.537474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:06.538243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:06.538680 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:06.671298 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:06.679397 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-91f0ad78-7e1a-482d-984d-4f135e1e2558 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.153727 Jul 29 04:51:06.682695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 260/524] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:06 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:07.702433 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:07.703045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:07.709559 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:07.709993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:07.710757 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:07.711201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:07.842381 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:07.849727 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-533994c9-d246-4119-ba1d-2b729145b397 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.151829 Jul 29 04:51:07.850286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 265/525] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:07 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:08.870886 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:08.872140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:08.878131 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:08.878574 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:08.879327 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:08.879758 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:09.237668 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:09.245143 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-18d93d65-b4d0-4959-a08e-1d6ee2635aa1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.378229 Jul 29 04:51:09.245907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 261/526] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:08 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:10.267607 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:10.268197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:10.274788 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:10.275226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:10.275989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:10.276428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:10.421129 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:10.428628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7c3b2bd0-a381-4915-ba99-69847a3d3344 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.165245 Jul 29 04:51:10.429314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 266/527] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:10 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:11.450389 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:11.451098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:11.457330 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:11.457776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:11.458535 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:11.458968 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:11.589965 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:11.598437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-67b07f52-65b1-494b-acd1-3f28406985e6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.152075 Jul 29 04:51:11.599023 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 262/528] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:11 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:12.619480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:12.620189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:12.627729 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:12.628189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:12.629003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:12.629446 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:12.763352 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:12.771162 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-775ad3ab-1c89-4012-9db6-a8a89e095bc5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.155667 Jul 29 04:51:12.771717 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 267/529] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:12 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:13.791413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:13.792095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:13.798889 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:13.799334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:13.800121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:13.800533 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:13.935436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:13.943510 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-44cd749e-0734-405d-b588-5549294cc9b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.155945 Jul 29 04:51:13.944141 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 263/530] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:13 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:14.966565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:14.967884 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:14.970406 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:14.971296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:14.980314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:14.980314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:14.980314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:14.980314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:15.119391 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:15.127907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b1bb3525-80b2-48dd-9374-47c7fa55051a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.166617 Jul 29 04:51:15.128819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 268/531] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:14 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:16.149390 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:16.150142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:16.151765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:16.157969 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:16.158417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:16.159345 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:16.159625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:16.348109 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:16.356678 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6fa438a3-19d2-47c4-b4ef-b176a0c0117a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.210448 Jul 29 04:51:16.357265 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 264/532] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:16 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:17.378030 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:17.378675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:17.380981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:17.387136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:17.387775 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:17.388690 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:17.389131 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:17.530093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:17.537962 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-60ca4d78-9483-494c-a40e-db3a8b4c2c92 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.163792 Jul 29 04:51:17.538583 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 269/533] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:17 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:18.561796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:18.562454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:18.569299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:18.569817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:18.570660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:18.571100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:18.706144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:18.713603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-49891ca3-d00e-4130-9566-95396ea21148 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.156906 Jul 29 04:51:18.714171 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 265/534] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:18 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:19.736966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:19.737603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:19.747500 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:19.747953 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:19.748779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:19.749225 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:19.890360 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:19.898927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-423b207d-697b-42ac-bdd7-5b3b02226384 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.167150 Jul 29 04:51:19.899505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 270/535] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:19 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:20.923093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:20.923701 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:20.929668 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:20.930115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:20.930863 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:20.931294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:21.063110 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:21.070674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6a58e391-e7b4-4bc0-b603-5a658502d6c6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.151639 Jul 29 04:51:21.071246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 266/536] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:20 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:22.091279 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:22.091897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:22.098628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:22.099100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:22.099863 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:22.100298 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:22.229865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:22.238056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f02254cf-abc0-484b-9a15-b4da9bb6f92c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.150667 Jul 29 04:51:22.238616 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 271/537] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:22 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:23.259802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:23.260409 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:23.268011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:23.268464 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:23.269258 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:23.269697 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:23.583214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:23.591424 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-75710bcc-bffd-4320-a800-60d1e36616f0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.335327 Jul 29 04:51:23.592139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 267/538] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:23 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:24.173413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-df161c99-ca70-4de0-a160-b2812466408b req-6f3cdd36-439a-4c63-bcd7-0033a84b6a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393b1a3-209a-4a5f-bc1f-82d40c318516", "tag": "74c48b51-41ba-4b30-aaba-fd0d90c6f624"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:24.187181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-df161c99-ca70-4de0-a160-b2812466408b req-6f3cdd36-439a-4c63-bcd7-0033a84b6a39 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:24.187639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-df161c99-ca70-4de0-a160-b2812466408b req-6f3cdd36-439a-4c63-bcd7-0033a84b6a39 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:24.202066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-df161c99-ca70-4de0-a160-b2812466408b req-6f3cdd36-439a-4c63-bcd7-0033a84b6a39 service nova] Creating event network-changed:74c48b51-41ba-4b30-aaba-fd0d90c6f624 for instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 on hv-cinder-85144 Jul 29 04:51:24.207513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-df161c99-ca70-4de0-a160-b2812466408b req-6f3cdd36-439a-4c63-bcd7-0033a84b6a39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040942 Jul 29 04:51:24.208274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 272/539] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:24.613387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:24.613996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:24.620196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:24.620867 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:24.621571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:24.621988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:24.754003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:24.762141 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cd703ea0-0ea7-4c4e-b9f2-b0ac67528868 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.152068 Jul 29 04:51:24.776111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 268/540] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:24 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:25.784265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:25.784991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:25.791252 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:25.791712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:25.793042 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:25.793745 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:25.920883 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:25.928185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5fb09d6b-0939-4a04-b156-bc21f581d74f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.148698 Jul 29 04:51:25.928838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 273/541] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:25 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:51:26.073436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-aa2011d8-8a64-4835-9a3d-0ee39aee44b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:26.074122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-aa2011d8-8a64-4835-9a3d-0ee39aee44b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:26.080005 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa2011d8-8a64-4835-9a3d-0ee39aee44b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:26.080452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa2011d8-8a64-4835-9a3d-0ee39aee44b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:26.081250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa2011d8-8a64-4835-9a3d-0ee39aee44b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:26.081685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa2011d8-8a64-4835-9a3d-0ee39aee44b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:26.104121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-aa2011d8-8a64-4835-9a3d-0ee39aee44b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.034523 Jul 29 04:51:26.104693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 269/542] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:51:26 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:26.950434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:26.950991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:26.957473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:26.957929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:26.958701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:26.959146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:27.085306 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:27.093384 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3df16837-0777-4765-befc-b37c49268166 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.147555 Jul 29 04:51:27.093949 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 274/543] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:26 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:27.282000 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-28ab87de-03d3-4015-b7bb-7999e330927c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:27.282551 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-28ab87de-03d3-4015-b7bb-7999e330927c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:27.288506 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-28ab87de-03d3-4015-b7bb-7999e330927c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:27.288981 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-28ab87de-03d3-4015-b7bb-7999e330927c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:27.289728 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-28ab87de-03d3-4015-b7bb-7999e330927c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:27.290162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-28ab87de-03d3-4015-b7bb-7999e330927c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:27.313990 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-28ab87de-03d3-4015-b7bb-7999e330927c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/ips" status: 200 len: 145 microversion: 2.1 time: 0.035765 Jul 29 04:51:27.314540 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 270/544] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:51:27 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:27.460972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8e61fb9b-99fa-4c47-a38f-c576851cd7e9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b559c0c9-410c-4490-bd36-72f16630c3bc"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:27.463948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8e61fb9b-99fa-4c47-a38f-c576851cd7e9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:27.470803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e61fb9b-99fa-4c47-a38f-c576851cd7e9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:27.471255 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e61fb9b-99fa-4c47-a38f-c576851cd7e9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:27.472061 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e61fb9b-99fa-4c47-a38f-c576851cd7e9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:27.472519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e61fb9b-99fa-4c47-a38f-c576851cd7e9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:28.114068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:28.114642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:28.121694 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:28.122385 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:28.123152 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:28.123586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:28.278692 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:28.286283 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-41d905ef-7694-40a2-92a9-9dd00f6cbce5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.176061 Jul 29 04:51:28.286902 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 271/545] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:28 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:51:28.608762 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8e61fb9b-99fa-4c47-a38f-c576851cd7e9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.151630 Jul 29 04:51:28.609381 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 275/546] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:51:27 2022] POST /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments => generated 194 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:29.307869 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:29.309102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:29.315325 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:29.315745 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5f031776-5806-40f1-8392-12740275b837 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca73f260-dc0b-4193-97d2-504d23c56db2"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:29.315890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:29.316661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:29.317164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:29.319233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5f031776-5806-40f1-8392-12740275b837 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:29.327283 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5f031776-5806-40f1-8392-12740275b837 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:29.327749 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5f031776-5806-40f1-8392-12740275b837 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:29.328537 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5f031776-5806-40f1-8392-12740275b837 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:29.329044 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5f031776-5806-40f1-8392-12740275b837 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:29.459489 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:29.469286 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-22025c0c-f1a1-4120-8c29-7cc39ab757e1 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.165441 Jul 29 04:51:29.469875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 272/547] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:29 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:29.606038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5f031776-5806-40f1-8392-12740275b837 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295228 Jul 29 04:51:29.606704 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 276/548] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:51:29 2022] POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:30.491619 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:30.492238 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:30.498994 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:30.499451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:30.500214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:30.500723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:30.628997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:30.636648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-10d886cd-0d18-45e8-b7da-bae545d0f26b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.148857 Jul 29 04:51:30.637321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 273/549] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:30 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:31.658454 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:31.659156 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:31.665755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:31.666209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:31.666983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:31.667426 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:31.801013 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:31.809109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3235f240-aef5-48f9-8b3b-feddfce5b433 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.154226 Jul 29 04:51:31.809806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 277/550] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:31 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:32.729349 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-3575fd0b-871f-4a0e-baa4-d292c337239d req-24847f71-5e7f-4b3a-8caa-c0e1360371a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393b1a3-209a-4a5f-bc1f-82d40c318516", "name": "network-vif-plugged", "status": "completed", "tag": "74c48b51-41ba-4b30-aaba-fd0d90c6f624"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:32.739515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-3575fd0b-871f-4a0e-baa4-d292c337239d req-24847f71-5e7f-4b3a-8caa-c0e1360371a2 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:32.739842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-3575fd0b-871f-4a0e-baa4-d292c337239d req-24847f71-5e7f-4b3a-8caa-c0e1360371a2 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:32.752257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-3575fd0b-871f-4a0e-baa4-d292c337239d req-24847f71-5e7f-4b3a-8caa-c0e1360371a2 service nova] Creating event network-vif-plugged:74c48b51-41ba-4b30-aaba-fd0d90c6f624 for instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 on hv-cinder-85144 Jul 29 04:51:32.757334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-3575fd0b-871f-4a0e-baa4-d292c337239d req-24847f71-5e7f-4b3a-8caa-c0e1360371a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 Jul 29 04:51:32.758001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 274/551] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:32.829357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:32.829974 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:32.836488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:32.837189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:32.837977 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:32.838417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:32.854179 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:32.976900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:32.985076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4204071c-afa8-4e5c-b2e9-74a9e0c8e6a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.159473 Jul 29 04:51:32.985670 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 278/552] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:32 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:34.006353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:34.007053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:34.008973 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:34.015614 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:34.016069 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:34.016860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:34.017300 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:34.021892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=83 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:34.145451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:34.152805 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-30834251-8882-41ed-87d6-580df15663d2 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.150626 Jul 29 04:51:34.153375 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 275/553] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:34 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:35.173954 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:35.174490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:35.181011 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:35.181468 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:35.182235 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:35.182678 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:35.553490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:35.561552 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-23817aa2-cdd1-4e13-ac16-ad1b4e744cce tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1357 microversion: 2.1 time: 0.391616 Jul 29 04:51:35.562103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 279/554] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:35 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1357 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:36.583025 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:36.583756 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:36.594627 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:36.595086 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:36.595867 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:36.596308 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:36.730407 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:36.738214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e29b2924-e1d5-4a0e-bf68-69e57d862684 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1546 microversion: 2.1 time: 0.159233 Jul 29 04:51:36.738779 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 276/555] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:36 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:36.759014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:36.759656 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:36.767764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:36.768241 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:36.769046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:36.769603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:36.899201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:36.906857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-90369fbc-00eb-43ba-a55e-48376d496c0c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1546 microversion: 2.1 time: 0.151695 Jul 29 04:51:36.907424 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 280/556] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:36 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:36.927331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:36.932007 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:36.932800 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Searching by: {'deleted': False, 'project_id': '21c0f0b9063948a9a0183b528bc21130'} {{(pid=129684) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 29 04:51:36.940322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:36.940810 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:36.941602 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:36.942041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:37.032270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.multi_cell_list [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129684) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 29 04:51:37.130893 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-01ed427b-f6e2-4b62-9d14-c4b4b510953d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207307 Jul 29 04:51:37.131472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 277/557] 10.222.0.40 () {58 vars in 1125 bytes} [Fri Jul 29 04:51:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:37.142651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:37.143258 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:37.149337 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:37.149790 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:37.150551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:37.150983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:37.213714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-60742574-8947-414c-a80d-b0e2a2f34837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: .version_select at 0x7f3c54602ee0>, body: {"keypair": {"name": "tempest-keypair-1388454543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLPqo18JXTnxLgU6elN0PJ5wsrpGRFBGEGs+3tY1lN0XrjQiLK4kQE5bhwX9EDP3dxYNLAqnUC8bJnZcz8xeyCkkkhUeRxoRTA7C8fdquwDo3mpvh8fdEWxFYe/FyLMvA=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:37.231821 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-60742574-8947-414c-a80d-b0e2a2f34837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:51:37.237163 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-60742574-8947-414c-a80d-b0e2a2f34837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:51:37.269879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-60742574-8947-414c-a80d-b0e2a2f34837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059463 Jul 29 04:51:37.271579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 278/558] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:51:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:51:37.311894 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:37.320371 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ac4d7d7e-0958-462a-87e5-3ab485729834 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1546 microversion: 2.1 time: 0.181345 Jul 29 04:51:37.321277 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 281/559] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:37 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:38.611037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1225826927", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ca39e1-cfc7-4b5b-897b-220faf26ce68"}], "security_groups": [{"name": "tempest-securitygroup--2025054375"}], "key_name": "tempest-keypair-1388454543", "user_data": "}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:38.949651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] validate_networks() for [('21ca39e1-cfc7-4b5b-897b-220faf26ce68', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:51:39.304907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:51:39.305338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:51:39.305819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:51:39.306234 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:51:39.306650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:51:39.315763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:39.316214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:39.317046 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:39.317486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:39.335011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:51:39.339017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:51:39.350600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:51:39.352852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:51:39.397441 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e4f4e473-0467-4260-bfa3-0395c0653238 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.791266 Jul 29 04:51:39.398260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 279/560] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:51:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:51:39.410668 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-36d678a9-e211-43a2-9c40-fac87703d3a5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:39.411497 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-36d678a9-e211-43a2-9c40-fac87703d3a5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:39.466327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-36d678a9-e211-43a2-9c40-fac87703d3a5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:39.473805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-36d678a9-e211-43a2-9c40-fac87703d3a5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1242 microversion: 2.1 time: 0.067713 Jul 29 04:51:39.474564 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 282/561] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:39 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:39.985865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f6d6b1b6-5ddf-45c6-868a-7ede39d841bb tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "427075d2-2f94-438f-bca0-1d00b5624132"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:39.988302 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f6d6b1b6-5ddf-45c6-868a-7ede39d841bb tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:39.994474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6d6b1b6-5ddf-45c6-868a-7ede39d841bb tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:39.994926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6d6b1b6-5ddf-45c6-868a-7ede39d841bb tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:39.995687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6d6b1b6-5ddf-45c6-868a-7ede39d841bb tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:39.996125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6d6b1b6-5ddf-45c6-868a-7ede39d841bb tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:40.494587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:40.495826 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:40.503857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:40.504302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:40.505435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:40.506115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:40.581369 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:40.589132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2e6b3351-435b-483b-aad6-004e50990a45 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1294 microversion: 2.1 time: 0.098510 Jul 29 04:51:40.589938 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 283/562] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:40 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:51:40.629780 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f6d6b1b6-5ddf-45c6-868a-7ede39d841bb tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.648692 Jul 29 04:51:40.630674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 280/563] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:51:39 2022] POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:41.611460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:41.612076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:41.618656 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:41.619113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:41.619882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:41.620329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:41.771867 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:41.779415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b0ef061c-93b5-4f7e-808b-4b05366fbf15 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.172108 Jul 29 04:51:41.779974 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 284/564] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:41 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:42.140646 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-696e0c27-4fda-49c5-a5b3-98140e7ac6bb req-7aae1a96-ebd9-4e63-ab86-2da5b0831901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dff02f-3754-41d5-85a6-d6e4e3a74922", "tag": "2334e019-9a68-4595-b751-e85232761217"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:42.156006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-696e0c27-4fda-49c5-a5b3-98140e7ac6bb req-7aae1a96-ebd9-4e63-ab86-2da5b0831901 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:42.156677 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-696e0c27-4fda-49c5-a5b3-98140e7ac6bb req-7aae1a96-ebd9-4e63-ab86-2da5b0831901 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:42.169451 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-696e0c27-4fda-49c5-a5b3-98140e7ac6bb req-7aae1a96-ebd9-4e63-ab86-2da5b0831901 service nova] Creating event network-changed:2334e019-9a68-4595-b751-e85232761217 for instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 on hv-cinder-85144 Jul 29 04:51:42.174648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-696e0c27-4fda-49c5-a5b3-98140e7ac6bb req-7aae1a96-ebd9-4e63-ab86-2da5b0831901 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038569 Jul 29 04:51:42.175355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 281/565] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:42.799529 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:42.800147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:42.806640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:42.807098 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:42.807903 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:42.808345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:42.936290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:42.943703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a03b0d0b-b26d-4160-9b72-4a2452cf3df5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.148041 Jul 29 04:51:42.944267 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 285/566] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:42 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:43.966726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:43.967446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:43.973780 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:43.974237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:43.975156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:43.975601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:44.181569 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:44.190633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-36b9963e-383a-44ac-872f-28002814df01 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.229211 Jul 29 04:51:44.191215 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 282/567] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:43 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:44.533210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-48cb831a-9237-453c-8829-9a1129730a74 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:44.539733 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-48cb831a-9237-453c-8829-9a1129730a74 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:44.540181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-48cb831a-9237-453c-8829-9a1129730a74 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:44.600544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-48cb831a-9237-453c-8829-9a1129730a74 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Going to try to stop instance {{(pid=129683) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 04:51:44.644028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-48cb831a-9237-453c-8829-9a1129730a74 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action" status: 202 len: 0 microversion: 2.1 time: 0.114552 Jul 29 04:51:44.644646 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 286/568] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:51:44 2022] POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:51:44.652971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:44.653718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:44.663933 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:44.664418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:44.665266 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:44.665714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:44.800956 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:44.809582 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a42565a9-5d5a-4ea4-8377-071dabd7f02a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.159834 Jul 29 04:51:44.810204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 283/569] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:44 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:51:45.211917 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:45.212657 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:45.219985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:45.220450 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:45.221253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:45.221701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:45.358529 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:45.365956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-eb9e96e0-336b-461c-b731-45a4be74ecd8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.158374 Jul 29 04:51:45.366525 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 287/570] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:45 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:45.831405 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:45.831971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:45.838534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:45.838987 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:45.839755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:45.840264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:45.975521 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:45.984369 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ffc9eb26-7f0b-4dc4-bfb9-02b74c9aa567 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.156929 Jul 29 04:51:45.985273 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 284/571] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:45 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:46.386675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:46.387317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:46.394160 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:46.394602 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:46.395366 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:46.395808 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:46.526278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:46.534377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2f2bc7cc-42df-401e-a1c1-333e8c9afbe6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.151692 Jul 29 04:51:46.534936 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 288/572] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:46 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:47.006699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:47.007575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:47.015541 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:47.016061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:47.016983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:47.017470 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:47.149745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:47.158548 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-147a914c-418e-4d97-9dc4-142b17bcd2c1 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.156059 Jul 29 04:51:47.159113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 285/573] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:47 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:47.556183 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:47.556824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:47.559324 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=42 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:47.565192 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:47.565649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:47.566426 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:47.566869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:47.709512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:47.717675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8aa8a842-0276-4041-8958-0551a8a28a9f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.165384 Jul 29 04:51:47.718246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 289/574] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:47 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:48.179886 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:48.180500 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:48.188134 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:48.188594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:48.189388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:48.189832 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:48.334225 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:48.342270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6fb5f88b-708a-48af-8518-3d7e9087af99 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.166132 Jul 29 04:51:48.342789 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 286/575] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:48 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:48.739545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:48.740341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:48.746833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:48.748092 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:48.748878 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:48.749327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:48.885663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:48.894122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b73c6351-a706-4585-a7ed-b05a1606468f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.158104 Jul 29 04:51:48.894229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 290/576] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:48 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:49.365093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:49.365682 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:49.368352 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=4 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:49.369097 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=10 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:49.377161 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:49.377633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:49.378533 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:49.378970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:49.511594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:49.520642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cb1d9a53-b738-4f29-b50c-136c4af68e43 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.159321 Jul 29 04:51:49.521231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 287/577] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:49 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:49.914854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:49.915498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:49.917349 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:49.923915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:49.924374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:49.925181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:49.925626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:50.058104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:50.072042 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3b78947b-c80c-42f7-aef5-f164329e6070 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.160912 Jul 29 04:51:50.072663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 291/578] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:49 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:51:50.542309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:50.543274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:50.550256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:50.550655 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:50.551414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:50.551845 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:50.694420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:50.703807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-61d04a36-7793-4bbd-8850-7f2b84ac426d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.165265 Jul 29 04:51:50.704436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 288/579] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:50 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:51.012478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-e216e8f8-d654-4ae6-8278-5eb19f3e0c1a req-431a01dc-e562-403a-9a68-9b28aef921c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42dff02f-3754-41d5-85a6-d6e4e3a74922", "name": "network-vif-plugged", "status": "completed", "tag": "2334e019-9a68-4595-b751-e85232761217"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:51.023353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-e216e8f8-d654-4ae6-8278-5eb19f3e0c1a req-431a01dc-e562-403a-9a68-9b28aef921c5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:51.023799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-e216e8f8-d654-4ae6-8278-5eb19f3e0c1a req-431a01dc-e562-403a-9a68-9b28aef921c5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:51.035581 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-e216e8f8-d654-4ae6-8278-5eb19f3e0c1a req-431a01dc-e562-403a-9a68-9b28aef921c5 service nova] Creating event network-vif-plugged:2334e019-9a68-4595-b751-e85232761217 for instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 on hv-cinder-85144 Jul 29 04:51:51.040734 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-e216e8f8-d654-4ae6-8278-5eb19f3e0c1a req-431a01dc-e562-403a-9a68-9b28aef921c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031858 Jul 29 04:51:51.041333 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 292/580] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:51.096527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:51.097477 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:51.103891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:51.104355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:51.105149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:51.105631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:51.245166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:51.253437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-31ea81e7-2197-4ed8-a533-77190b6bf6f7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.163228 Jul 29 04:51:51.254179 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 289/581] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:51 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:51.727261 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:51.727964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:51.734976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:51.735454 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:51.736216 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:51.736685 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:51.882786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:51.892347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-50d21755-687c-46d5-be2a-cd8f3e42b7d9 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.169366 Jul 29 04:51:51.892960 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 293/582] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:51 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:52.274794 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:52.275616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:52.282515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:52.283173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:52.284053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:52.284494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:52.435298 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:52.443016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c0aa2ae5-afec-4343-b3fc-dd51cb735001 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.172201 Jul 29 04:51:52.443731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 290/583] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:52 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:52.914362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:52.914960 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:52.922335 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:52.922824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:52.923627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:52.924073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:53.055633 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:53.064645 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-137505dd-06d8-437b-986e-f5cad602e975 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.154590 Jul 29 04:51:53.065261 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 294/584] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:52 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:53.463224 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:53.463831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:53.470359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:53.470803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:53.471557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:53.471990 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:53.599790 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:53.607722 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2affb2b3-3d15-4945-8ccc-beb517e9bf6e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1368 microversion: 2.1 time: 0.148285 Jul 29 04:51:53.608283 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 291/585] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:53 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:54.091268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:54.093048 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:54.099625 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:54.100015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:54.100820 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:54.101263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:54.238071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:54.240411 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:54.248427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-107814a6-5985-44c8-9409-0844bad920b5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.164061 Jul 29 04:51:54.249099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 295/586] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:54 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:54.628212 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:54.628843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:54.635265 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:54.635695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:54.636452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:54.636915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:54.651835 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:51:54.782093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:54.789729 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-028be784-39ab-48cc-afbf-ec3f6ba6cc5f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1557 microversion: 2.1 time: 0.165302 Jul 29 04:51:54.790340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 292/587] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:54 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:54.812723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-504adcfc-8529-4149-9109-f4b84525067a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:54.813218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-504adcfc-8529-4149-9109-f4b84525067a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:54.819779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-504adcfc-8529-4149-9109-f4b84525067a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:54.820233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-504adcfc-8529-4149-9109-f4b84525067a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:54.821032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-504adcfc-8529-4149-9109-f4b84525067a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:54.821471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-504adcfc-8529-4149-9109-f4b84525067a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:54.904374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-504adcfc-8529-4149-9109-f4b84525067a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097001 Jul 29 04:51:54.905033 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 296/588] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:51:54 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:55.270343 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:55.271162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:55.277411 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:55.277859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:55.278772 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:55.279312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:55.430709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:55.439534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c9b07842-118f-4f74-ab23-c11910684170 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.173031 Jul 29 04:51:55.440118 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 293/589] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:55 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:55.686990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:55.687606 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:55.693753 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:55.694200 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:55.695046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:55.695490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:55.887881 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:55.895815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0e244dc2-dfed-423b-a28b-52394931841b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1592 microversion: 2.1 time: 0.213742 Jul 29 04:51:55.896384 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 297/590] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:55 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1592 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:55.988574 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-b0c92865-5e2e-484b-8126-a7c0266ce269 req-c5684e76-c260-4205-8f24-a18657751950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dff02f-3754-41d5-85a6-d6e4e3a74922", "tag": "2334e019-9a68-4595-b751-e85232761217"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:56.000128 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b0c92865-5e2e-484b-8126-a7c0266ce269 req-c5684e76-c260-4205-8f24-a18657751950 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:56.000582 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b0c92865-5e2e-484b-8126-a7c0266ce269 req-c5684e76-c260-4205-8f24-a18657751950 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:56.012158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-b0c92865-5e2e-484b-8126-a7c0266ce269 req-c5684e76-c260-4205-8f24-a18657751950 service nova] Creating event network-changed:2334e019-9a68-4595-b751-e85232761217 for instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 on hv-cinder-85144 Jul 29 04:51:56.017852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-b0c92865-5e2e-484b-8126-a7c0266ce269 req-c5684e76-c260-4205-8f24-a18657751950 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032805 Jul 29 04:51:56.019064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 294/591] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:56.461339 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:56.462346 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:56.472327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:56.473613 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:56.474674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:56.475392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:56.722856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:56.736332 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a6c162db-6272-4521-b47b-0443fbdee30c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.279338 Jul 29 04:51:56.743237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 298/592] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:56 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:57.761516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:57.762230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:57.770085 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:57.770537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:57.771311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:57.771755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:57.912295 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:57.920655 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7c231220-cf65-4273-97ed-447847b6c303 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.163853 Jul 29 04:51:57.921232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 295/593] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:57 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:58.032643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-053f860c-7cdb-4848-ae04-4a04f88b5659 req-bd21a5a4-18ae-4472-b3f3-ca43a57feaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393b1a3-209a-4a5f-bc1f-82d40c318516", "tag": "74c48b51-41ba-4b30-aaba-fd0d90c6f624"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:58.042477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-053f860c-7cdb-4848-ae04-4a04f88b5659 req-bd21a5a4-18ae-4472-b3f3-ca43a57feaa7 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:58.043185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-053f860c-7cdb-4848-ae04-4a04f88b5659 req-bd21a5a4-18ae-4472-b3f3-ca43a57feaa7 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:58.056754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-053f860c-7cdb-4848-ae04-4a04f88b5659 req-bd21a5a4-18ae-4472-b3f3-ca43a57feaa7 service nova] Creating event network-changed:74c48b51-41ba-4b30-aaba-fd0d90c6f624 for instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 on hv-cinder-85144 Jul 29 04:51:58.062641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-053f860c-7cdb-4848-ae04-4a04f88b5659 req-bd21a5a4-18ae-4472-b3f3-ca43a57feaa7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Jul 29 04:51:58.063669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 299/594] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:51:58.943017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:58.944317 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:58.953709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:58.954166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:58.954976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:58.955610 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:59.019956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-695076605"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:51:59.020821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:59.027297 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:59.027783 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:59.029154 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:59.029778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:59.101453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:59.110196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9507bf11-f7ed-4801-bed5-aec5b71a7703 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.171307 Jul 29 04:51:59.111310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 296/595] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:58 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:51:59.171210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.network.security_group_api [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Adding security group 9d2ad824-5001-497b-afa2-545b0f5f4ab0 to port 74c48b51-41ba-4b30-aaba-fd0d90c6f624 Jul 29 04:51:59.540106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2d070e5a-feed-4b9f-8310-b8bcf623d7b5 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/action" status: 202 len: 0 microversion: 2.1 time: 0.524403 Jul 29 04:51:59.540948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 300/596] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:51:59 2022] POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 04:51:59.549681 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:51:59.550292 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:51:59.556322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:59.556803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:59.557568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:51:59.558001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:51:59.725757 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:51:59.738853 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-81ca4c61-c2f3-4b19-83d2-c5c6a4f06b5a tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1756 microversion: 2.1 time: 0.193026 Jul 29 04:51:59.739523 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 297/597] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:51:59 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:00.078006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-6f1e0fe9-c43d-4137-a472-7b763e5bda69 req-d760b534-3ccc-4a8a-bb7b-23df5116426f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393b1a3-209a-4a5f-bc1f-82d40c318516", "tag": "74c48b51-41ba-4b30-aaba-fd0d90c6f624"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:00.088314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-6f1e0fe9-c43d-4137-a472-7b763e5bda69 req-d760b534-3ccc-4a8a-bb7b-23df5116426f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:00.088805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-6f1e0fe9-c43d-4137-a472-7b763e5bda69 req-d760b534-3ccc-4a8a-bb7b-23df5116426f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:00.101162 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-6f1e0fe9-c43d-4137-a472-7b763e5bda69 req-d760b534-3ccc-4a8a-bb7b-23df5116426f service nova] Creating event network-changed:74c48b51-41ba-4b30-aaba-fd0d90c6f624 for instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 on hv-cinder-85144 Jul 29 04:52:00.107345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-6f1e0fe9-c43d-4137-a472-7b763e5bda69 req-d760b534-3ccc-4a8a-bb7b-23df5116426f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032142 Jul 29 04:52:00.108129 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 301/598] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:52:00.132671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:00.133277 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:00.139791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:00.140234 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:00.141206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:00.141643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:00.368453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:00.377197 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6c899cac-52a1-4c03-8b1a-f6ae726033c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.248321 Jul 29 04:52:00.377789 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 298/599] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:00 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:01.400372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:01.401114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:01.407363 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:01.407818 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:01.408584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:01.409056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:01.540833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:01.549635 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-869d7edd-ad37-40f7-97a5-0096cacbee80 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.154021 Jul 29 04:52:01.550199 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 302/600] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:01 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:02.571124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:02.571736 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:02.578252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:02.578705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:02.579467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:02.579909 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:02.710822 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:02.718913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3d699750-e788-4da4-bacf-5506ccee9430 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.151782 Jul 29 04:52:02.719494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 299/601] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:02 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:03.741062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:03.741849 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:03.749597 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:03.750056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:03.750822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:03.751256 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:03.885826 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:03.894948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-062e2667-6fe1-40b2-a67c-a2246a9be04b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1724 microversion: 2.1 time: 0.157798 Jul 29 04:52:03.895691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 303/602] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:03 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:04.916441 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:04.916979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:04.919755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:04.925166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:04.925621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:04.926384 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:04.926824 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:05.064306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:05.072410 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6eab6243-f5c7-4a94-9c3e-71f1aea4db8f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1701 microversion: 2.1 time: 0.159877 Jul 29 04:52:05.072956 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 300/603] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:04 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:05.094009 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0edfd9e0-9b01-44a0-85e0-817f70c7252c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:05.100628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0edfd9e0-9b01-44a0-85e0-817f70c7252c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:05.101089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0edfd9e0-9b01-44a0-85e0-817f70c7252c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:05.123778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0edfd9e0-9b01-44a0-85e0-817f70c7252c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Going to try to start instance {{(pid=129683) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 04:52:05.165107 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0edfd9e0-9b01-44a0-85e0-817f70c7252c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action" status: 202 len: 0 microversion: 2.1 time: 0.075268 Jul 29 04:52:05.165723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 304/604] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:52:05 2022] POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:52:05.174419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:05.175031 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:05.181495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:05.181961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:05.182759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:05.183227 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:05.326364 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:05.334541 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-107c693b-7048-4e25-8d34-1445c21534bd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1710 microversion: 2.1 time: 0.164035 Jul 29 04:52:05.335127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 301/605] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:05 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:06.357295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:06.357913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:06.364057 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:06.364511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:06.365295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:06.365732 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:06.502347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:06.510409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-32e2516d-c695-4c9c-84aa-66726f24832e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1710 microversion: 2.1 time: 0.158118 Jul 29 04:52:06.510975 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 305/606] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:06 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:07.533375 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:07.533887 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:07.540703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:07.541157 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:07.541915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:07.542349 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:07.676946 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:07.684862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-15567822-0150-45ed-9901-2b60f69c19fa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1714 microversion: 2.1 time: 0.155405 Jul 29 04:52:07.685421 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 302/607] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:52:07 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:52:12.871431 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7b9e6d8f-7fe2-41f5-b174-87f6ce2d1672 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:12.872484 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7b9e6d8f-7fe2-41f5-b174-87f6ce2d1672 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:12.878606 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7b9e6d8f-7fe2-41f5-b174-87f6ce2d1672 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:12.879064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7b9e6d8f-7fe2-41f5-b174-87f6ce2d1672 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:12.880288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7b9e6d8f-7fe2-41f5-b174-87f6ce2d1672 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:12.881111 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7b9e6d8f-7fe2-41f5-b174-87f6ce2d1672 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:12.909708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7b9e6d8f-7fe2-41f5-b174-87f6ce2d1672 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.042641 Jul 29 04:52:12.910197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 306/608] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Jul 29 04:52:12 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:52:14.756496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:14.757065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:14.763837 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:14.764284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:14.765074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:14.765583 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:14.788418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lazy-loading 'flavor' on Instance uuid 630ff067-c10b-4ae9-8d92-c40d206fd0ca {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:52:15.003513 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b9a694a4-8219-4e35-b1a7-4db513004259 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/action" status: 202 len: 0 microversion: 2.20 time: 0.250903 Jul 29 04:52:15.004164 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 303/609] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Jul 29 04:52:14 2022] POST /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:52:15.013084 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:15.013697 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:15.020255 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:15.020736 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:15.021506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:15.021938 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:15.154772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:15.162539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:15.164032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:15.165265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-548f0d8b-54e2-4d56-a743-ca55369eafa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.156703 Jul 29 04:52:15.165774 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 307/610] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:15 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:52:16.188488 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:16.189229 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:16.196433 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:16.197096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:16.197831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:16.198318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:16.327493 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:16.335557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:16.337122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:16.338284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6c11e14d-810e-41ab-a7a2-438e5f6c8263 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.154660 Jul 29 04:52:16.338865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 304/611] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:16 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:17.361783 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:17.362405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:17.368913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:17.369371 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:17.370135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:17.370606 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:17.498003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:17.505907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:17.507427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:17.508585 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-345b63f1-6b63-42b5-8cef-8a67aedfc701 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.150799 Jul 29 04:52:17.509166 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 308/612] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:17 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:18.531340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:18.531975 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:18.538769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:18.539257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:18.540028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:18.540542 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:18.669994 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:18.677859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:18.679349 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:18.680493 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2735e2d8-e924-4a1b-b396-a89406e3f63b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.153099 Jul 29 04:52:18.681081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 305/613] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:18 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:19.708168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:19.708852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:19.711234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=40 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:19.717063 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:19.718447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:19.719223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:19.719657 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:19.989038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:19.998021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:19.999548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:20.000745 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4ccfc67a-3848-4548-8bf5-6a07835398c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.299092 Jul 29 04:52:20.001305 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 309/614] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:19 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:21.023447 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:21.024240 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:21.031689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:21.032124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:21.032916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:21.033359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:21.214497 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:21.222527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:21.224091 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:21.225231 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d8b1ded8-9caa-4036-8577-e3cebed0b00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.205890 Jul 29 04:52:21.225797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 306/615] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:21 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:22.248728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:22.249343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:22.255724 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:22.256168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:22.256948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:22.257383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:22.389476 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:22.397318 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:22.398819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:22.399967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-942b9efd-deea-41a3-a55c-1c22cca5cad7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.155398 Jul 29 04:52:22.400526 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 310/616] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:22 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:23.423889 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:23.424514 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:23.432284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:23.432793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:23.433645 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:23.434100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:23.563355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:23.565658 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:23.572935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:23.575065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:23.576222 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7eb98c8f-d0be-41dc-9d6f-3f5ef75ad59e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.156275 Jul 29 04:52:23.576844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 307/617] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:23 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:24.599376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:24.599984 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:24.606849 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:24.607307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:24.608071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:24.608512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:24.738038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:24.745959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:24.747458 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:24.748588 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-099ffe26-a2e0-483a-84b6-7448265a1477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.153313 Jul 29 04:52:24.749163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 311/618] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:24 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:25.771898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:25.772507 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:25.780008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:25.780493 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:25.781299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:25.781739 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:25.915767 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:25.924773 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:25.926282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:25.927432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-968298ee-dc89-4f3a-8f82-f986c813c5cc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.160176 Jul 29 04:52:25.928001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 308/619] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:25 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:26.951859 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:26.952498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:26.958980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:26.959434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:26.960197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:26.960661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:26.964480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:27.091919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:27.099746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:27.101288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:27.102433 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-899f5caf-347e-463d-9f1b-7ad59b2e87bb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.155611 Jul 29 04:52:27.102979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 312/620] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:26 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:28.124977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:28.125586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:28.132229 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:28.132700 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:28.133488 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:28.133923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:28.260161 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:28.268618 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:28.270122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:28.271268 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-96c1e97d-5eaa-4d20-ae42-192365486e9b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1744 microversion: 2.20 time: 0.150335 Jul 29 04:52:28.271820 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 309/621] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:28 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:29.297553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:29.298101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:29.304614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:29.305083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:29.305850 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:29.306295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:29.435741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:29.443701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:29.445252 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:29.446434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f533f9cb-4a55-4423-a093-03d065397b78 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1744 microversion: 2.20 time: 0.153597 Jul 29 04:52:29.446981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 313/622] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:29 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:30.468968 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:30.469547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:30.475961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:30.476405 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:30.477195 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:30.477631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:30.609027 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:30.616808 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:30.618333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:30.619480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a0deaee9-312a-48cc-82e0-81d207aef978 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1744 microversion: 2.20 time: 0.154475 Jul 29 04:52:30.620035 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 310/623] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:30 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:31.302548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-a5b0b2a6-cf96-4296-9bc4-39cd58ae1bad req-2b3fbbc5-c255-4d15-a89a-b750f3ccafd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630ff067-c10b-4ae9-8d92-c40d206fd0ca", "name": "network-vif-plugged", "status": "completed", "tag": "1f4eb45a-ea71-4ede-b569-032c9dddfac4"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:31.316814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-a5b0b2a6-cf96-4296-9bc4-39cd58ae1bad req-2b3fbbc5-c255-4d15-a89a-b750f3ccafd0 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:31.317272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-a5b0b2a6-cf96-4296-9bc4-39cd58ae1bad req-2b3fbbc5-c255-4d15-a89a-b750f3ccafd0 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:31.328978 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-a5b0b2a6-cf96-4296-9bc4-39cd58ae1bad req-2b3fbbc5-c255-4d15-a89a-b750f3ccafd0 service nova] Creating event network-vif-plugged:1f4eb45a-ea71-4ede-b569-032c9dddfac4 for instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca on hv-cinder-85144 Jul 29 04:52:31.334628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-a5b0b2a6-cf96-4296-9bc4-39cd58ae1bad req-2b3fbbc5-c255-4d15-a89a-b750f3ccafd0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036157 Jul 29 04:52:31.336021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 314/624] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:52:31.642100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:31.642747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:31.649318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:31.649776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:31.650548 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:31.650991 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:31.780144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:31.788110 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:31.789648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:31.790810 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e6bce3d4-20a8-4b6f-aa1f-29f9e04f7ca0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1744 microversion: 2.20 time: 0.152655 Jul 29 04:52:31.791376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 311/625] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:31 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:32.815237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:32.815945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:32.822638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:32.823093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:32.823859 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:32.824514 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:32.952981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:32.960954 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:32.962479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:32.963647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-58731daa-5035-41a2-99c7-5ff3962adeaf tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1744 microversion: 2.20 time: 0.152733 Jul 29 04:52:32.964204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 315/626] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:32 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:33.989073 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:33.989674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:33.996134 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:33.996576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:33.997351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:33.997782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:34.129236 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:34.137687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:34.139206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:34.140372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c20db42a-070e-4b27-8e6a-86c7be5e5910 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1744 microversion: 2.20 time: 0.155382 Jul 29 04:52:34.140985 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 312/627] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:33 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:35.163046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:35.163659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:35.171264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:35.171722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:35.172493 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:35.172971 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:35.304005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:35.312038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:35.313601 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:35.314741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d0011d80-e5c8-4d77-9717-e4dc22f25ee5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1744 microversion: 2.20 time: 0.155665 Jul 29 04:52:35.315294 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 316/628] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:35 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:36.340473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:36.342523 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:36.345208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=26 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:36.351144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:36.351794 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:36.352583 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:36.353058 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:36.496196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:36.504654 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:36.506214 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:36.507411 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d119199a-c371-4de2-9626-095deec718b8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.172670 Jul 29 04:52:36.507979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 313/629] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:36 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:52:37.531113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:37.531824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:37.538311 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:37.539008 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:37.539828 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:37.540300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:37.693880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:37.704094 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:37.705635 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:37.707016 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ebd021e5-8c6a-4e11-b0f7-90773b8d3270 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.180123 Jul 29 04:52:37.707740 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 317/630] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:37 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:38.732409 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:38.733084 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:38.740575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:38.741212 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:38.741998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:38.742443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:38.888358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:38.898443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:38.899969 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:38.901236 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b43003a0-f815-4f70-bbee-8fa7f5d55061 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.174105 Jul 29 04:52:38.913388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 314/631] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:38 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:39.931734 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:39.932567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:39.942837 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:39.943323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:39.944444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:39.946969 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:40.098286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:40.107556 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:40.110194 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:40.111410 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8b9de667-3ea9-4c1a-bdd2-9cb137d6a4fd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.184378 Jul 29 04:52:40.113620 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 318/632] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:39 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:41.137066 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:41.137687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:41.144180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:41.144656 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:41.145722 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:41.146242 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:41.290378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:41.299559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:41.302954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:41.304817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2530644e-fd09-4bd6-b7a5-4418745c14ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.172028 Jul 29 04:52:41.317367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 315/633] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:41 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:42.333285 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:42.334376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:42.342135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:42.342956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:42.343741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:42.344360 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:42.497418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:42.506044 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:42.507733 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:42.508933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c814ae3c-6413-433c-9a39-2ac79e7f7c6a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.180757 Jul 29 04:52:42.509712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 319/634] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:42 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:43.532458 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:43.533183 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:43.539709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:43.540172 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:43.540974 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:43.541418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:43.700496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:43.709287 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:43.710834 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:43.711979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ffd78036-119f-455d-bdf4-79346c6da07b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.183505 Jul 29 04:52:43.726726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 316/635] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:43 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:44.739418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:44.740270 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:44.749276 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:44.749276 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:44.749881 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:44.750473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:44.899230 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:44.909299 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:44.911133 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:44.912412 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ab58428c-dd1b-4c8c-aa0b-c145691e12d5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.176869 Jul 29 04:52:44.913011 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 320/636] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:44 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:52:45.935512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:45.936123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:45.942850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:45.943331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:45.944102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:45.944540 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:46.076653 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:46.084490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:46.085953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:46.087125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-99ead82d-e6f3-4f85-9782-59cce0295454 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1739 microversion: 2.20 time: 0.155636 Jul 29 04:52:46.087708 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 317/637] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:45 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:47.111761 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:47.112401 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:47.119051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:47.119506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:47.121018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:47.121603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:47.252061 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:47.260306 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:47.262430 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:47.263596 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7bf8b796-7192-40f0-9831-f4cdacac6c07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1721 microversion: 2.20 time: 0.155746 Jul 29 04:52:47.264159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 321/638] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:47 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:48.286541 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:48.287158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:48.294130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:48.294587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:48.295353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:48.295791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:48.424723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:48.432766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:48.434294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:48.435491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-58f60187-4d49-4d9f-88fc-64c0ecfe274d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1721 microversion: 2.20 time: 0.152842 Jul 29 04:52:48.436060 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 318/639] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:48 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:49.458567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:49.459173 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:49.466194 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:49.466662 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:49.467460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:49.467953 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:49.595979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:49.604059 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:49.605624 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:49.606845 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4cc2b382-5eee-494a-8011-1bcc12cbd666 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1724 microversion: 2.20 time: 0.152177 Jul 29 04:52:49.608142 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 322/640] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:49 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:49.630494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e8841040-8d76-4c85-a940-cb85fff37364 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b6bde30-17b6-4547-8099-fb993b1ade8b"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:49.632787 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e8841040-8d76-4c85-a940-cb85fff37364 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:49.640324 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8841040-8d76-4c85-a940-cb85fff37364 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:49.640814 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8841040-8d76-4c85-a940-cb85fff37364 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:49.641589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8841040-8d76-4c85-a940-cb85fff37364 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:49.642028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8841040-8d76-4c85-a940-cb85fff37364 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:49.920323 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e8841040-8d76-4c85-a940-cb85fff37364 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.293553 Jul 29 04:52:49.920954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 319/641] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Jul 29 04:52:49 2022] POST /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:52:50.041237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:50.042091 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:50.044021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=28 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:50.049752 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:50.050214 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:50.050977 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:50.051416 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:50.137343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129683) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 04:52:50.206498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9d0703f7-38a5-4a55-ad0f-9beab93bcf8d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/action" status: 202 len: 0 microversion: 2.20 time: 0.169188 Jul 29 04:52:50.207201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 323/642] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Jul 29 04:52:50 2022] POST /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:52:50.215285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:50.215905 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:50.223345 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:50.223797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:50.224557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:50.225031 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:50.357211 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:50.367496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:50.369037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:50.370251 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9e5fa7dd-eb50-4003-81a4-e9b1f80b8bd7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1750 microversion: 2.20 time: 0.158881 Jul 29 04:52:50.370805 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 320/643] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:50 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:51.331976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-709ee4b3-7f2b-4e4b-9a2b-14689e68be96 req-64a1b10d-f4d6-496c-8b1e-db57ea6b6b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630ff067-c10b-4ae9-8d92-c40d206fd0ca", "name": "network-vif-unplugged", "status": "completed", "tag": "1f4eb45a-ea71-4ede-b569-032c9dddfac4"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:51.342333 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-709ee4b3-7f2b-4e4b-9a2b-14689e68be96 req-64a1b10d-f4d6-496c-8b1e-db57ea6b6b4a service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:51.342786 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-709ee4b3-7f2b-4e4b-9a2b-14689e68be96 req-64a1b10d-f4d6-496c-8b1e-db57ea6b6b4a service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:51.354246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.compute.server_external_events [req-709ee4b3-7f2b-4e4b-9a2b-14689e68be96 req-64a1b10d-f4d6-496c-8b1e-db57ea6b6b4a service nova] Unable to find a host for instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca. Dropping event network-vif-unplugged {{(pid=129683) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 04:52:51.355131 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-709ee4b3-7f2b-4e4b-9a2b-14689e68be96 req-64a1b10d-f4d6-496c-8b1e-db57ea6b6b4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029163 Jul 29 04:52:51.355724 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 324/644] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 29 04:52:51.393589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:51.394278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:51.401467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:51.401922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:51.402693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:51.403130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:51.540249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:51.542729 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:52:51.549672 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:51.551168 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:51.552313 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b39eee04-3e9a-4cd7-b1d6-9f43f4c056e4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1752 microversion: 2.20 time: 0.162822 Jul 29 04:52:51.553462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 321/645] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:51 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:52.578362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:52.581077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:52.587463 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:52.587919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:52.588981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:52.589483 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:52.731958 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:52.741929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:52.743457 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:52.745069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-af0f3e6a-24af-4cd2-923e-2dc17b4256bd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.172110 Jul 29 04:52:52.745632 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 325/646] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:52 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:53.770414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:53.771641 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:53.780873 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:53.781329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:53.782126 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:53.782575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:53.920817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:53.930187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:53.931830 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:53.933305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e04af0b5-a621-4af8-87b1-f8bd0bf32d6c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.169146 Jul 29 04:52:53.933996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 322/647] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:53 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:54.431551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ec9b388a-5518-4d09-ae27-7d745b14785e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6f87a6b-233b-4272-952f-f1c6abc09968"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:52:54.434287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ec9b388a-5518-4d09-ae27-7d745b14785e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:54.441251 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec9b388a-5518-4d09-ae27-7d745b14785e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:54.442582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec9b388a-5518-4d09-ae27-7d745b14785e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:54.443651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec9b388a-5518-4d09-ae27-7d745b14785e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:54.444286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec9b388a-5518-4d09-ae27-7d745b14785e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:54.956902 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:54.957448 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:54.976197 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:54.976680 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:54.977514 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:54.977959 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:55.123032 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:55.132161 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:55.133953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:55.135196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fdf99bb5-8392-457a-9c06-861df1e18691 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.182425 Jul 29 04:52:55.136041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 323/648] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:54 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:56.162252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:56.163689 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:56.171492 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:56.171950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:56.172759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:56.173204 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:56.305725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:56.314979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:56.316502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:56.317712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-10f3aebe-56f7-4e64-95bb-2c34184203d9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.161999 Jul 29 04:52:56.324770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 324/649] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:56 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:52:57.342001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:57.344353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:57.351781 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:57.352906 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:57.354200 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:57.354793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:57.496814 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:57.506472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:57.507986 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:57.509178 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a2c8ef19-9e24-4549-a564-7e11731e6c40 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.171348 Jul 29 04:52:57.509961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 325/650] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:57 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:52:58.532245 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:58.533731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:58.541014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:58.541472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:58.542530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:58.542977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:58.683428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:58.703639 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:58.705271 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:58.706495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0fe6eadf-3782-4dba-9465-3807ee5b3644 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.178293 Jul 29 04:52:58.707291 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 326/651] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:58 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:52:59.729869 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:52:59.730562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:52:59.737714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:59.738177 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:59.738939 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:52:59.739380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:52:59.880113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:59.889234 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:59.890849 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:52:59.892166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cef6c5e9-7662-4e82-a42b-9a00b8996954 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.166044 Jul 29 04:52:59.892802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 327/652] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:52:59 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:00.917763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:00.918532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:00.926001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:00.926446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:00.927233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:00.927675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:01.073586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:01.082138 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:01.083648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:01.084840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d3316635-70d7-4752-8041-ef61ef81923c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.171558 Jul 29 04:53:01.085401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 328/653] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:00 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:02.107979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:02.109078 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:02.114613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:02.115087 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:02.115851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:02.116284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:02.247096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:02.257848 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:02.259365 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:02.260553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7511c8a1-383b-4fb7-8831-57b7fada0ca8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.157162 Jul 29 04:53:02.261339 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 329/654] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:02 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:03.284068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:03.284830 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:03.293287 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:03.293739 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:03.294703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:03.295882 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:03.436725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:03.446454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:03.447928 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:03.449115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1e9af995-48fc-40b3-98ab-ba15fdfa7f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.169037 Jul 29 04:53:03.458275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 330/655] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:03 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:04.438486 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:04.472784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:04.473400 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:04.479983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:04.480441 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:04.481266 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:04.481750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:04.526717 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:04.629552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:04.638253 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:04.639780 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:04.640989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-45c9d607-c6be-4ab7-ba4e-05b82c0878ee tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.172103 Jul 29 04:53:04.641553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 331/656] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:04 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:05.663305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:05.663924 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:05.671165 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:05.671621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:05.672398 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:05.672879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:05.798174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:05.806559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:05.808069 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:05.809254 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d2805c05-7f66-4b15-98c9-e6081ef45dfe tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.149912 Jul 29 04:53:05.810334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 332/657] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:05 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:06.833869 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:06.834515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:06.836867 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=40 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:06.842351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:06.842802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:06.843566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:06.844005 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:06.976061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:06.985020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:06.986516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:06.987738 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-68943d3f-c67f-445d-a709-b8396d8e7e1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.157762 Jul 29 04:53:06.988303 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 333/658] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:06 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:08.011600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:08.012268 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:08.019236 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:08.019682 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:08.020444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:08.020903 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:08.147144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:08.155679 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:08.157216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:08.158363 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-876132a3-9b93-429a-ae3f-c619facddcac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.150688 Jul 29 04:53:08.158924 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 334/659] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:08 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:09.181624 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:09.182341 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:09.189048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:09.189504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:09.190269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:09.190711 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:09.319832 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:09.328978 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:09.330487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:09.331645 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8d06ebc9-c58f-4255-86ce-76b8d42cff27 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.153948 Jul 29 04:53:09.332219 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 335/660] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:09 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:10.355332 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:10.356028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:10.362814 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:10.363255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:10.364011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:10.364447 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:10.491724 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:10.500568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:10.502116 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:10.503277 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a595a99d-4166-4665-bd7d-0ed2da491548 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.152149 Jul 29 04:53:10.503837 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 336/661] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:10 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:11.526008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:11.526665 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:11.533265 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:11.533696 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:11.534475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:11.534912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:11.677398 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:11.686550 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:11.688065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:11.689468 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f5439482-30cf-4b46-b74b-f4bda1c9fe48 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.167423 Jul 29 04:53:11.690025 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 337/662] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:11 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:11.696907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ec9b388a-5518-4d09-ae27-7d745b14785e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.381998 Jul 29 04:53:11.697751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 326/663] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:52:54 2022] POST /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments => generated 194 bytes in 17384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:53:12.712566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:12.713232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:12.719988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:12.720441 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:12.721246 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:12.721670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:12.736215 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:12.850662 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:12.859635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:12.861216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:12.862410 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-796269bf-211d-4b2d-b32c-aea3f92d7c22 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.153745 Jul 29 04:53:12.862982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 338/664] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:12 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:13.886684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:13.887384 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:13.894640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:13.895090 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:13.895852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:13.896288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:14.024547 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:14.033534 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:14.035045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:14.036201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-364d7e78-7112-4be9-89e4-a9e6cea5c755 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.154255 Jul 29 04:53:14.036784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 327/665] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:13 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:15.059279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:15.059885 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:15.066599 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:15.067048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:15.067801 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:15.068238 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:15.195593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:15.204622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:15.206111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:15.207279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-781217ca-9dbf-4f79-bfa2-0564f659c422 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.151848 Jul 29 04:53:15.207844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 339/666] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:15 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:16.231361 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:16.231983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:16.239215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:16.239675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:16.240441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:16.240913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:16.373216 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:16.381608 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:16.383105 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:16.384280 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cd2200f9-61b1-473c-b445-25ed61d130d8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.156941 Jul 29 04:53:16.384874 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 328/667] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:16 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:17.407227 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:17.407760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:17.414262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:17.414708 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:17.415453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:17.415885 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:17.546908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:17.555216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:17.556746 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:17.557896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-62e29991-3475-4cb9-9c93-0bb8b7198a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.154686 Jul 29 04:53:17.558459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 340/668] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:17 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:18.581929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:18.582542 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:18.589103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:18.589565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:18.590343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:18.590791 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:18.719744 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:18.728111 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:18.729653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:18.730820 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-366f003b-94ac-4a5f-a54e-e3f5beb43137 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.152797 Jul 29 04:53:18.731386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 329/669] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:18 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:19.754324 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:19.754936 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:19.761632 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:19.762086 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:19.762851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:19.763294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:19.907923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:19.916860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:19.918445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:19.919701 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4880fd95-a893-4122-9afd-6e8269db53cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.169349 Jul 29 04:53:19.921076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 341/670] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:19 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:20.277678 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:20.281193 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:20.287737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:20.288192 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:20.289001 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:20.289442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:20.317071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lazy-loading 'flavor' on Instance uuid f027c23f-8c17-419b-80a0-bdb62b416da3 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:53:20.467634 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-332f2dae-03b1-40c1-975a-52780cb46d7c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/action" status: 200 len: 32 microversion: 2.1 time: 0.193986 Jul 29 04:53:20.468390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 330/671] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:53:20 2022] POST /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:53:20.480232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:20.481175 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:20.496437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:20.496932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:20.497726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:20.498377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:20.766115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:20.774940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3a151abc-9a28-45a5-9398-5ca44e7563a4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.300614 Jul 29 04:53:20.775639 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 342/672] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:20 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:20.948189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:20.948933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:20.956261 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:20.956750 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:20.957535 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:20.957976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:21.103623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:21.112436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:21.113979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:21.115151 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-06bdc582-8188-46b6-bc2d-7b1ba83e8b1b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.175339 Jul 29 04:53:21.115696 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 331/673] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:20 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:21.696039 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-0e5cd209-ef83-4ab5-8c3e-245288965d91 req-fdd586ab-6d22-4777-b330-dc1742958621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630ff067-c10b-4ae9-8d92-c40d206fd0ca", "name": "network-vif-plugged", "status": "completed", "tag": "1f4eb45a-ea71-4ede-b569-032c9dddfac4"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:21.706503 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-0e5cd209-ef83-4ab5-8c3e-245288965d91 req-fdd586ab-6d22-4777-b330-dc1742958621 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:21.706955 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-0e5cd209-ef83-4ab5-8c3e-245288965d91 req-fdd586ab-6d22-4777-b330-dc1742958621 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:21.718083 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-0e5cd209-ef83-4ab5-8c3e-245288965d91 req-fdd586ab-6d22-4777-b330-dc1742958621 service nova] Creating event network-vif-plugged:1f4eb45a-ea71-4ede-b569-032c9dddfac4 for instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca on hv-cinder-85144 Jul 29 04:53:21.723213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-0e5cd209-ef83-4ab5-8c3e-245288965d91 req-fdd586ab-6d22-4777-b330-dc1742958621 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094297 Jul 29 04:53:21.723807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 343/674] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:53:21.801215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:21.802283 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:21.808514 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:21.809017 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:21.809797 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:21.810744 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:21.943929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:21.952473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4413eb6a-86e9-4875-bfb0-887ac7984de6 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.155182 Jul 29 04:53:21.953068 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 332/675] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:21 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:22.138559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:22.139302 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:22.146075 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:22.146529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:22.147291 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:22.147732 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:22.277420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:22.286510 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:22.288272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:22.289474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cf61deaa-df9f-41b8-bdaa-30b9c5a40618 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.155317 Jul 29 04:53:22.290177 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 344/676] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:22 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:22.973932 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:22.974495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:22.981047 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:22.981495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:22.983103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:22.983553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:23.116684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:23.124879 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b62c2c3b-4b1a-4d9a-861b-0481ad126b42 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.154852 Jul 29 04:53:23.125456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 333/677] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:22 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:23.278321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1047de15-686a-4e88-91cc-d0d942692b5d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:23.281261 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1047de15-686a-4e88-91cc-d0d942692b5d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:23.287728 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1047de15-686a-4e88-91cc-d0d942692b5d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:23.288174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1047de15-686a-4e88-91cc-d0d942692b5d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:23.288957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1047de15-686a-4e88-91cc-d0d942692b5d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:23.289389 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1047de15-686a-4e88-91cc-d0d942692b5d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:23.313482 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:23.314155 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:23.320160 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:23.320645 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:23.321421 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:23.321905 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:23.367435 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1047de15-686a-4e88-91cc-d0d942692b5d tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/action" status: 202 len: 0 microversion: 2.1 time: 0.092807 Jul 29 04:53:23.372862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 345/678] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:53:23 2022] POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:53:23.377862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:23.378554 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:23.384816 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:23.385270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:23.386063 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:23.386502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:23.462619 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:23.471920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:23.473481 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:23.474685 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-22168917-4312-48cd-b1f6-3b1fa0d72df9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.165321 Jul 29 04:53:23.475253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 334/679] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:23 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:53:23.536188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:23.545322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-86c837c0-6d50-43dc-9bbb-87ac1401708f tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1748 microversion: 2.1 time: 0.172141 Jul 29 04:53:23.545884 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 346/680] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:23 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:24.146012 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:24.146642 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:24.153116 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:24.153576 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:24.154985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:24.155436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:24.289849 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:24.299435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-da207396-6dd4-4158-9f7f-cb7382c02c66 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.157340 Jul 29 04:53:24.304686 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 335/681] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:24 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:24.498356 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:24.499115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:24.505535 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:24.505984 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:24.506748 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:24.507187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:24.567784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:24.568477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:24.575206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:24.575669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:24.577910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:24.578250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:24.652850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:24.661844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:24.663282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:24.664559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a79a85f2-77fb-4c9d-a8f3-d6ca5670cff6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1808 microversion: 2.20 time: 0.170568 Jul 29 04:53:24.665343 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 347/682] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:24 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:24.737070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:24.745540 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e51d9ad2-d358-4c6d-8f49-e8e5c8310cfd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1748 microversion: 2.1 time: 0.182360 Jul 29 04:53:24.746102 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 336/683] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:24 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1748 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:25.322145 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:25.322753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:25.329795 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:25.330248 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:25.331012 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:25.331452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:25.460509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:25.469530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4d5ba872-de14-42c5-abc5-989be990b149 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.151246 Jul 29 04:53:25.470100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 348/684] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:25 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:25.688180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:25.688831 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:25.695661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:25.696114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:25.696954 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:25.697398 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:25.768793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:25.769377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:25.776474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:25.777324 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:25.778113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:25.778550 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:25.845854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:25.855627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:25.858027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:25.859471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a228f658-1f3a-42b0-a8b8-248d49ee48dd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1795 microversion: 2.20 time: 0.175800 Jul 29 04:53:25.870733 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 337/685] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:53:25 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1795 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:53:25.923505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:25.931461 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-01d01872-587c-42d1-bc86-d1778dc91596 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1748 microversion: 2.1 time: 0.166968 Jul 29 04:53:25.932105 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 349/686] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:25 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:26.491111 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:26.491900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:26.498715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:26.499265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:26.500045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:26.500492 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:26.634182 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:26.642177 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cfe25aa3-7b95-4c35-9af3-b2ab3418c10c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.155006 Jul 29 04:53:26.642739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 338/687] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:26 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:26.953131 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:26.953647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:26.960148 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:26.960616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:26.961391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:26.961831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:27.104693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:27.112578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1f55978c-52a9-4132-87e9-fa3b714e1989 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.163425 Jul 29 04:53:27.113158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 350/688] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:26 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:27.664643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:27.665272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:27.672096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:27.672557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:27.673358 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:27.673804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:27.802695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:27.811148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d1818423-cbfc-467f-8ce7-95a5e7020f74 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.150462 Jul 29 04:53:27.811710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 339/689] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:27 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:28.135407 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:28.136030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:28.142776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:28.143232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:28.143997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:28.144439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:28.288154 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:28.297432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cafeffbb-a57f-4048-b059-e74f2c068da4 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.165829 Jul 29 04:53:28.298013 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 351/690] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:28 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:28.831310 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:28.831925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:28.838515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:28.838970 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:28.839730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:28.840171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:28.844132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:28.968466 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:28.976323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-227a6b1d-e0db-4453-b52d-31d563266ef0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.148861 Jul 29 04:53:28.976929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 340/691] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:28 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:29.318651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:29.319257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:29.326218 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:29.326664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:29.327420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:29.327854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:29.469335 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:29.477159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d0434157-ba3f-4621-974f-6e2075f03210 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.162387 Jul 29 04:53:29.477720 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 352/692] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:29 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:29.998803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:29.999430 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:30.005882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:30.006335 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:30.007110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:30.007554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:30.139392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:30.147394 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-db61e5d8-1688-40cc-b942-2d777709e645 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.153285 Jul 29 04:53:30.147966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 341/693] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:29 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:30.498732 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:30.499364 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:30.506075 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:30.506473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:30.507240 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:30.507684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:30.649000 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:30.658097 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e94218e9-967e-415d-99d9-f97af593f524 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.163409 Jul 29 04:53:30.658674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 353/694] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:30 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:31.168772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:31.169907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:31.176373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:31.176852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:31.177610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:31.178050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:31.306503 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:31.314653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-319434db-20cb-42c6-a537-57fa32f83ba0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.150009 Jul 29 04:53:31.315220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 342/695] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:31 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:31.680919 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:31.681537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:31.688046 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:31.688475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:31.689275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:31.689719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:31.832410 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:31.835090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:31.843463 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c292bf60-3d04-45d6-adf5-7a34960d889c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.166460 Jul 29 04:53:31.844078 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 354/696] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:31 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:32.335451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:32.336063 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:32.342620 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:32.343078 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:32.343853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:32.344299 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:32.474611 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:32.483005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-438086d7-ae4c-4fcf-8d44-8771ec77fce9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.151603 Jul 29 04:53:32.483562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 343/697] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:32 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:32.865285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:32.865896 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:32.874165 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:32.874621 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:32.875384 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:32.875827 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:33.018240 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:33.026139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-415cf9ec-3249-4b9c-91f2-3267c7a9d650 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.164848 Jul 29 04:53:33.026699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 355/698] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:32 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:33.504466 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:33.505100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:33.511991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:33.511991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:33.513730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:33.514195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:33.643171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:33.651343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b8aad30a-744a-473b-b276-514cb6063e6e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.150744 Jul 29 04:53:33.651957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 344/699] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:33 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:34.048960 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:34.049547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:34.055530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:34.055972 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:34.056759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:34.057193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:34.197481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:34.205699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9ca76c03-29dc-44d2-974b-3f85679ac568 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.161691 Jul 29 04:53:34.206426 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 356/700] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:34 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:34.673403 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:34.674018 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:34.676307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=37 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:34.681720 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:34.682172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:34.682944 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:34.683392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:34.776147 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:34.776674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:34.783540 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:34.784012 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:34.784861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:34.785310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:34.821567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:34.830221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8b0f3639-a518-47ba-9a5c-2803f156c4f7 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.160927 Jul 29 04:53:34.830794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 345/701] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:34 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:34.909455 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'services' on Instance uuid 32c9906c-fdab-4215-a1c5-5cb82c3ab79e {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:53:35.020839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7896aa08-9638-4af2-9bcc-94b03d7900a3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-volume_attachments/ca73f260-dc0b-4193-97d2-504d23c56db2" status: 202 len: 0 microversion: 2.1 time: 0.349195 Jul 29 04:53:35.021429 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 357/702] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:53:34 2022] DELETE /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-volume_attachments/ca73f260-dc0b-4193-97d2-504d23c56db2 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 04:53:35.227214 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:35.227823 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:35.233866 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:35.234322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:35.235084 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:35.235526 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:35.378771 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:35.386635 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d7cc631d-740e-4e10-a93d-67e9a2d0388c tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.163329 Jul 29 04:53:35.387211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 346/703] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:35 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:35.853865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:35.854549 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:35.861777 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:35.862225 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:35.862983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:35.863419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:35.991866 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:35.999703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5204717f-286b-4c6a-b7d8-c296f6243f96 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.150519 Jul 29 04:53:36.000268 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 358/704] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:35 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:36.141119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e6aebc63-1071-475b-aef2-a79edbaf3f0a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:36.147788 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e6aebc63-1071-475b-aef2-a79edbaf3f0a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:36.148247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e6aebc63-1071-475b-aef2-a79edbaf3f0a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:36.172066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e6aebc63-1071-475b-aef2-a79edbaf3f0a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Going to try to stop instance {{(pid=129683) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 04:53:36.216944 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e6aebc63-1071-475b-aef2-a79edbaf3f0a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action" status: 202 len: 0 microversion: 2.1 time: 0.079227 Jul 29 04:53:36.217466 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 347/705] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:53:36 2022] POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:53:36.225484 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:36.226103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:36.232495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:36.232985 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:36.233758 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:36.234369 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:36.369575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:36.377276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4107d3ef-a7cf-40c3-a87a-73cb50769474 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.155573 Jul 29 04:53:36.377878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 359/706] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:36 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:36.409166 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:36.409907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:36.416287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:36.416787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:36.417560 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:36.418005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:36.559187 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:36.568056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a4a09014-18b9-4c22-8185-7fcf6f9aad00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.163706 Jul 29 04:53:36.568629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 348/707] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:36 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:37.020708 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:37.021381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:37.023750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=54 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:37.029294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:37.029753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:37.030522 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:37.030964 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:37.158612 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:37.166846 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0bc84501-98bd-4a19-b632-56a898fe19b8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.149974 Jul 29 04:53:37.167406 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 360/708] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:37 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:37.399188 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:37.399727 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:37.406752 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:37.407204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:37.407955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:37.408392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:37.540202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:37.548591 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-644ae7a6-5077-4d14-87a6-bf9a46e8fe88 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.153394 Jul 29 04:53:37.549180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 349/709] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:37 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:37.590102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:37.590794 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:37.597642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:37.598241 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:37.598846 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:37.599279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:37.743961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:37.751988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ea33c419-0fec-4e2c-9116-e3b1bbe6d2b6 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.165751 Jul 29 04:53:37.752552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 361/710] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:37 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:38.189352 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:38.189996 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:38.196051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:38.196509 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:38.197306 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:38.197752 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:38.324582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:38.333118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-90ecd72b-6790-4dcd-8cd1-fa583d7cf09e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.148312 Jul 29 04:53:38.333685 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 350/711] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:38 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:38.569884 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:38.570501 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:38.577078 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:38.577529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:38.578297 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:38.578737 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:38.704156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:38.712049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6e58cf39-40de-47d7-9760-94aa18911253 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.146007 Jul 29 04:53:38.712678 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 362/712] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:38 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:38.773594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:38.774234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:38.781041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:38.781497 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:38.782267 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:38.782714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:38.926875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:38.935293 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-be50e794-49f9-42f2-9ac7-8848967335b8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.165034 Jul 29 04:53:38.935865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 351/713] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:38 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:39.356759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:39.357355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:39.363467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:39.363925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:39.364723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:39.365172 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:39.495269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:39.503821 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-132b1b39-f4f7-41cb-a044-afaa026eb4d8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.151968 Jul 29 04:53:39.504392 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 363/714] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:39 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:39.733099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:39.733716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:39.739793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:39.740246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:39.741039 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:39.741481 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:39.870520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:39.878446 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e0b3f1c0-5e49-46b9-bd71-93d2ba7f730a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.149358 Jul 29 04:53:39.879003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 352/715] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:39 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:39.956500 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:39.957261 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:39.963749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:39.964198 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:39.964985 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:39.965424 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:40.105237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:40.114637 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-47e59385-2d9a-4b29-9ad5-049ec8a60633 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.161944 Jul 29 04:53:40.115213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 364/716] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:39 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:40.524705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:40.525325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:40.532205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:40.532687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:40.533460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:40.533908 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:40.659872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:40.668246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-261b6b70-2b66-49f3-abc7-e3116582efec tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1736 microversion: 2.1 time: 0.147385 Jul 29 04:53:40.668844 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 353/717] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:40 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:40.899272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:40.899791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:40.906397 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:40.906839 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:40.907593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:40.908024 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:41.039799 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:41.047737 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d458d964-9d55-4f14-8e00-224242dc1a2a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.152367 Jul 29 04:53:41.048301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 365/718] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:40 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:41.136282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:41.136925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:41.144145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:41.144639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:41.145399 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:41.145842 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:41.289135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:41.297260 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ed00a4f4-13fc-43d8-b5b5-a955f509f0a8 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.164796 Jul 29 04:53:41.297829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 354/719] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:41 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:41.689895 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:41.690510 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:41.697035 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:41.697490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:41.698264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:41.698706 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:41.824975 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:41.833096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e7141676-9e2a-496c-927b-8e4cf1db3dd2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1716 microversion: 2.1 time: 0.147105 Jul 29 04:53:41.833659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 366/720] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:41 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:41.898160 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:41.898742 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:41.905327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:41.905726 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:41.906495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:41.906940 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.024724 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:42.030419 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] HTTP exception thrown: Cannot 'detach_volume' instance f027c23f-8c17-419b-80a0-bdb62b416da3 while it is in vm_state rescued Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Request method failure captured: Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: DELETE /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments/b6f87a6b-233b-4272-952f-f1c6abc09968 HTTP/1.1 Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZhlNNaO7HnMZzvgbxie8U5RKqqwvq_Bq6GMJi5VZh7oiuxTWcZp_kC9HxflMzmzIMuMvOP9TRm4TMboTmNgulYrkVZgRQLQCFy247oo2-KsOMTwWtV0ThTLvBHwpFQbue4zcZdxDvH6Tsa_H2roUzECLDDqCk-Yda_F3VRh8ODwP8 Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:53:42.032007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 5f9d45265c6f47609f9f8abcf3526ff0 Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:53:42.033383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Cannot 'detach_volume' instance f027c23f-8c17-419b-80a0-bdb62b416da3 while it is in vm_state rescued Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'server_id': 'f027c23f-8c17-419b-80a0-bdb62b416da3', 'id': 'b6f87a6b-233b-4272-952f-f1c6abc09968'} Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f027c23f-8c17-419b-80a0-bdb62b416da3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:53:42.034066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f027c23f-8c17-419b-80a0-bdb62b416da3 while it is in vm_state rescued Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f027c23f-8c17-419b-80a0-bdb62b416da3 while it is in vm_state rescued Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:42.035405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Returning 409 to user: Cannot 'detach_volume' instance f027c23f-8c17-419b-80a0-bdb62b416da3 while it is in vm_state rescued {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:53:42.036684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a91eece7-5d17-471d-a55c-6b08c393318a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments/b6f87a6b-233b-4272-952f-f1c6abc09968" status: 409 len: 152 microversion: 2.1 time: 0.139377 Jul 29 04:53:42.036684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 355/721] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:53:41 2022] DELETE /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments/b6f87a6b-233b-4272-952f-f1c6abc09968 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 04:53:42.042554 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b7de88ba-e5ac-4bf2-9d93-2f557d6725ff tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:42.043089 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b7de88ba-e5ac-4bf2-9d93-2f557d6725ff tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:42.049881 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7de88ba-e5ac-4bf2-9d93-2f557d6725ff tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.050335 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7de88ba-e5ac-4bf2-9d93-2f557d6725ff tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.051094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7de88ba-e5ac-4bf2-9d93-2f557d6725ff tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.051530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b7de88ba-e5ac-4bf2-9d93-2f557d6725ff tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.069546 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:42.070151 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:42.078297 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.078758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.079542 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.079991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.123146 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b7de88ba-e5ac-4bf2-9d93-2f557d6725ff tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "POST /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/action" status: 202 len: 0 microversion: 2.1 time: 0.084418 Jul 29 04:53:42.126911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 367/722] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:53:42 2022] POST /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 04:53:42.132282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:42.133065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:42.140167 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.141298 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.142088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.142534 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.222584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:42.230628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-71536aa2-7b63-4b1d-b23e-c83581e570cf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.164775 Jul 29 04:53:42.231266 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 356/723] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:42 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:42.308622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:42.317076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-42888bd8-2155-49e5-a4c2-ce078114d427 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1724 microversion: 2.1 time: 0.188765 Jul 29 04:53:42.317643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 368/724] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:42 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:42.318524 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:42.319148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:42.325754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.326207 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.326983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:42.327427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:42.473663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:42.485654 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-187cfc4f-1964-4e9a-b68f-fdfa0a75f669 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1753 microversion: 2.1 time: 0.169115 Jul 29 04:53:42.486229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 357/725] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:42 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:43.252530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:43.253172 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:43.259930 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:43.260386 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:43.261190 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:43.261636 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:43.339268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:43.339807 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:43.346940 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:43.347409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:43.348196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:43.348692 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:43.482264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:43.483536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:43.485843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:43.493036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3946cdd5-a4b6-4a4d-b84a-eeae6fe9091d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.244295 Jul 29 04:53:43.493658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8a4331fb-7257-4221-9619-b31e1be79641 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1724 microversion: 2.1 time: 0.158321 Jul 29 04:53:43.494139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 369/726] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:43 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:43.494918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 358/727] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:43 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:43.508435 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:43.509344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:43.516876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:43.517338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:43.518102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:43.518546 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:43.662815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:43.671766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-888a2081-7cfc-4659-a1ca-55c6ddc639ec tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1756 microversion: 2.1 time: 0.168348 Jul 29 04:53:43.672342 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 370/728] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:43 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:44.516725 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:44.517346 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:44.519388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:44.520001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:44.523919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:44.524372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:44.525180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:44.525623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:44.526360 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:44.526818 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:44.527580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:44.528812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:44.660027 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:44.665272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:44.668449 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-74a0b9fb-712d-4ee1-947d-9ab79639c774 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1724 microversion: 2.1 time: 0.152713 Jul 29 04:53:44.669067 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 371/729] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:44 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:44.671979 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-63b547c4-9637-47fe-b3b2-ec34f55df13d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.159623 Jul 29 04:53:44.674069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 359/730] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:44 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:45.690719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:45.691420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:45.692802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:45.693424 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:45.698958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:45.699413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:45.700353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:45.700995 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:45.701408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:45.701532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:45.702191 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:45.702633 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:45.833955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:45.834598 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:45.842113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-93fccf28-6f9d-4396-bd46-8e36d968e435 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.153071 Jul 29 04:53:45.842536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5e923726-37fa-4e36-a6bd-c17b5d9c7929 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1724 microversion: 2.1 time: 0.155782 Jul 29 04:53:45.843096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 372/731] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:45 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:45.847094 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 360/732] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:45 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:46.863247 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:46.863863 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:46.864478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:46.865119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:46.870545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:46.870995 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:46.871615 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:46.872308 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:46.872440 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:46.872548 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:46.873074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:46.873518 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:47.005477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:47.006980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:47.014827 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f91b75b8-3016-4e0e-a54c-bc0baca9a67a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1730 microversion: 2.1 time: 0.154023 Jul 29 04:53:47.015011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9cf422c2-d36b-4bc1-8f45-686eedc7b78a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.155545 Jul 29 04:53:47.015407 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 361/733] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:46 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:47.015546 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 373/734] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:46 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:47.034869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ac0b0b61-e3ec-4520-b418-7cfc67c7be8d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:47.035361 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ac0b0b61-e3ec-4520-b418-7cfc67c7be8d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:47.041583 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac0b0b61-e3ec-4520-b418-7cfc67c7be8d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:47.042035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac0b0b61-e3ec-4520-b418-7cfc67c7be8d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:47.042800 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac0b0b61-e3ec-4520-b418-7cfc67c7be8d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:47.043241 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ac0b0b61-e3ec-4520-b418-7cfc67c7be8d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:47.123923 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ac0b0b61-e3ec-4520-b418-7cfc67c7be8d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092660 Jul 29 04:53:47.124520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 362/735] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:53:47 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:53:48.036461 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:48.037187 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:48.044854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:48.045396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:48.046253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:48.046767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:48.085755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-8eda474c-b623-4075-8f86-cd00c4e9bd6d req-373d34d4-ed4f-422e-b5f1-748318d8e46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f027c23f-8c17-419b-80a0-bdb62b416da3", "tag": "aee6ef22-26d9-4a6a-b997-015edcbf797e"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:48.096913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-8eda474c-b623-4075-8f86-cd00c4e9bd6d req-373d34d4-ed4f-422e-b5f1-748318d8e46b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:48.097486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-8eda474c-b623-4075-8f86-cd00c4e9bd6d req-373d34d4-ed4f-422e-b5f1-748318d8e46b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:48.110018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-8eda474c-b623-4075-8f86-cd00c4e9bd6d req-373d34d4-ed4f-422e-b5f1-748318d8e46b service nova] Creating event network-changed:aee6ef22-26d9-4a6a-b997-015edcbf797e for instance f027c23f-8c17-419b-80a0-bdb62b416da3 on hv-cinder-85144 Jul 29 04:53:48.115036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-8eda474c-b623-4075-8f86-cd00c4e9bd6d req-373d34d4-ed4f-422e-b5f1-748318d8e46b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106932 Jul 29 04:53:48.115818 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 374/736] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:53:48.181072 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:48.189873 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b950a6e3-33b1-462c-a43f-d1aabd86544b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.157606 Jul 29 04:53:48.190450 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 363/737] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:48 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:49.211569 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:49.212184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:49.219140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:49.219587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:49.220347 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:49.220831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:49.346454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:49.353998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f6ea4185-fbe2-4c07-9e54-42adeb8099e5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.147282 Jul 29 04:53:49.354575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 375/738] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:49 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:50.130989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-ece257db-07e4-415c-8edc-953ca48532ed req-e45f54c2-b460-4c07-af25-fadbd1e16747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f027c23f-8c17-419b-80a0-bdb62b416da3", "tag": "aee6ef22-26d9-4a6a-b997-015edcbf797e"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:50.141240 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ece257db-07e4-415c-8edc-953ca48532ed req-e45f54c2-b460-4c07-af25-fadbd1e16747 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:50.141683 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ece257db-07e4-415c-8edc-953ca48532ed req-e45f54c2-b460-4c07-af25-fadbd1e16747 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:50.152224 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-ece257db-07e4-415c-8edc-953ca48532ed req-e45f54c2-b460-4c07-af25-fadbd1e16747 service nova] Creating event network-changed:aee6ef22-26d9-4a6a-b997-015edcbf797e for instance f027c23f-8c17-419b-80a0-bdb62b416da3 on hv-cinder-85144 Jul 29 04:53:50.157812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-ece257db-07e4-415c-8edc-953ca48532ed req-e45f54c2-b460-4c07-af25-fadbd1e16747 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030522 Jul 29 04:53:50.158368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 364/739] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:53:50.376370 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:50.376953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:50.383190 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:50.383638 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:50.384406 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:50.384943 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:50.577532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:50.585216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0922cf75-28e3-4fbb-a342-7d216214f72a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.213229 Jul 29 04:53:50.585792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 376/740] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:50 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:51.608328 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:51.609067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:51.615275 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:51.615729 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:51.616499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:51.616971 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:51.755660 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:51.763572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c5108dbf-e08d-4d63-96b7-dc24a8f32191 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1678 microversion: 2.1 time: 0.160564 Jul 29 04:53:51.764810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 365/741] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:51 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:52.787167 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:52.787768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:52.795445 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.795975 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.796862 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.797396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.813760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c9506300-c068-49a5-bf17-aac2ddbf3cf9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:52.814312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c9506300-c068-49a5-bf17-aac2ddbf3cf9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:52.820545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9506300-c068-49a5-bf17-aac2ddbf3cf9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.821271 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9506300-c068-49a5-bf17-aac2ddbf3cf9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.822050 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9506300-c068-49a5-bf17-aac2ddbf3cf9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.822497 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c9506300-c068-49a5-bf17-aac2ddbf3cf9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.848129 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c9506300-c068-49a5-bf17-aac2ddbf3cf9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922/ips" status: 200 len: 149 microversion: 2.1 time: 0.096110 Jul 29 04:53:52.849020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 377/742] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:53:52 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:53:52.860462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b559c0c9-410c-4490-bd36-72f16630c3bc"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:52.863495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:52.870920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.870920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.872874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.873530 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.945470 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:52.953485 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bf940ebe-0a08-4eb9-87c3-aca6250b1686 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1655 microversion: 2.1 time: 0.171758 Jul 29 04:53:52.953920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 366/743] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:52 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1655 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:52.961947 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Invalid volume: volume b559c0c9-410c-4490-bd36-72f16630c3bc is already attached to instances: 94d225e6-c457-47da-bb55-5620ad7f15e7 Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: POST /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922/os-volume_attachments HTTP/1.1 Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 74 Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:53:52.963712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {"volumeAttachment": {"volumeId": "b559c0c9-410c-4490-bd36-72f16630c3bc"}} Jul 29 04:53:52.965900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Invalid volume: volume b559c0c9-410c-4490-bd36-72f16630c3bc is already attached to instances: 94d225e6-c457-47da-bb55-5620ad7f15e7 Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'server_id': '42dff02f-3754-41d5-85a6-d6e4e3a74922', 'body': {'volumeAttachment': {'volumeId': 'b559c0c9-410c-4490-bd36-72f16630c3bc'}}} Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b559c0c9-410c-4490-bd36-72f16630c3bc is already attached to instances: 94d225e6-c457-47da-bb55-5620ad7f15e7 Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:53:52.966899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b559c0c9-410c-4490-bd36-72f16630c3bc is already attached to instances: 94d225e6-c457-47da-bb55-5620ad7f15e7 Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:52.968030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:53:52.969966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:53:52.969966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:53:52.969966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:53:52.969966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b559c0c9-410c-4490-bd36-72f16630c3bc is already attached to instances: 94d225e6-c457-47da-bb55-5620ad7f15e7 Jul 29 04:53:52.969966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:53:52.969966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 400 to user: Invalid volume: volume b559c0c9-410c-4490-bd36-72f16630c3bc is already attached to instances: 94d225e6-c457-47da-bb55-5620ad7f15e7 {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:53:52.969966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0e309a8d-81c9-413f-a0a5-4607588d318e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109337 Jul 29 04:53:52.970556 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 378/744] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:53:52 2022] POST /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 04:53:52.975797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6d2003e0-be24-4033-a8ed-02eb4a8a31b8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:52.975954 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:52.976335 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:52.982684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.983150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.983359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d2003e0-be24-4033-a8ed-02eb4a8a31b8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.983819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d2003e0-be24-4033-a8ed-02eb4a8a31b8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:52.983920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:52.984359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:53.012897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:53:53.048645 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6d2003e0-be24-4033-a8ed-02eb4a8a31b8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Going to try to start instance {{(pid=129684) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 04:53:53.097332 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6d2003e0-be24-4033-a8ed-02eb4a8a31b8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action" status: 202 len: 0 microversion: 2.1 time: 0.124958 Jul 29 04:53:53.098106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 379/745] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:53:52 2022] POST /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:53:53.098705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2842f1ab-3397-40b4-8df8-c56264ccaefa tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 204 len: 0 microversion: 2.1 time: 0.126443 Jul 29 04:53:53.099417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 367/746] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:53:52 2022] DELETE /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:53:53.108096 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:53.108835 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:53.115379 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:53.115840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:53.116082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:53.116652 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:53.117106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:53.117612 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:53.126406 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:53.126864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:53.127655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:53.128097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:53.253907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:53.261826 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f8106ff4-c7a8-48f8-af41-2484a745d213 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1682 microversion: 2.1 time: 0.158125 Jul 29 04:53:53.272706 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 380/747] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:53 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:53.273272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:53.274935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-451228bc-e83a-4290-a51e-bd15c12aa949 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1664 microversion: 2.1 time: 0.165243 Jul 29 04:53:53.275656 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 368/748] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:53 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:54.284022 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:54.284795 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:54.291595 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:54.292042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:54.292837 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:54.293352 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:54.295240 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:54.295851 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:54.302048 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:54.302493 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:54.303257 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:54.303691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:54.427350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:54.435404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-53372bfc-0da3-4846-91d4-d48d41bee80e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1682 microversion: 2.1 time: 0.155190 Jul 29 04:53:54.436142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 381/749] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:54 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:54.439745 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:54.447969 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6273b454-58fc-460b-b73f-93b3bd884d76 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1664 microversion: 2.1 time: 0.156384 Jul 29 04:53:54.448753 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 369/750] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:54 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:53:55.456811 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:55.457360 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:55.464121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:55.464629 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:55.465491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:55.466297 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:55.471885 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:55.472531 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:55.479605 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:55.480069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:55.481278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:55.481914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:55.621909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:55.631626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-95ef58d4-1553-42cf-8fa2-e11542daa33e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1664 microversion: 2.1 time: 0.163927 Jul 29 04:53:55.632198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 370/751] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:55 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:55.812800 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:55.820215 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a166487c-a5d4-4d39-bd61-59a39438b2b9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1682 microversion: 2.1 time: 0.367423 Jul 29 04:53:55.821037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 382/752] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:55 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1682 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:56.489690 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-8bec0668-c0d3-40f0-9a12-fcdf29db36c4 req-c15d577a-03a2-4101-b869-0107d139a5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42dff02f-3754-41d5-85a6-d6e4e3a74922", "name": "network-vif-deleted", "tag": "2334e019-9a68-4595-b751-e85232761217"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:53:56.499505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-8bec0668-c0d3-40f0-9a12-fcdf29db36c4 req-c15d577a-03a2-4101-b869-0107d139a5db service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:56.500033 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-8bec0668-c0d3-40f0-9a12-fcdf29db36c4 req-c15d577a-03a2-4101-b869-0107d139a5db service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:56.511136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-8bec0668-c0d3-40f0-9a12-fcdf29db36c4 req-c15d577a-03a2-4101-b869-0107d139a5db service nova] Creating event network-vif-deleted:2334e019-9a68-4595-b751-e85232761217 for instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 on hv-cinder-85144 Jul 29 04:53:56.516904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-8bec0668-c0d3-40f0-9a12-fcdf29db36c4 req-c15d577a-03a2-4101-b869-0107d139a5db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089021 Jul 29 04:53:56.517513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 371/753] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:53:56.654765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:56.657115 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:56.663607 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:56.664213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:56.665025 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:56.665466 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:56.802940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:56.812337 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ea6a94be-3e3c-4634-9b4f-84b8bf89316d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1664 microversion: 2.1 time: 0.162339 Jul 29 04:53:56.819122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 383/754] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:56 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:56.842351 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:56.843143 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:56.849441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:56.849964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:56.850808 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:56.851308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:56.870755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:53:56.935260 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:56.944092 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-09aa2f16-eb26-4fb9-9e1d-037efd2b6376 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 200 len: 1614 microversion: 2.1 time: 0.106162 Jul 29 04:53:56.946993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 372/755] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:56 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 1614 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:57.833971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:57.834575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:57.841715 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:57.842158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:57.842909 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:57.843342 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:57.969278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:57.969899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:57.971698 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:53:57.977213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:57.977668 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:57.978449 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:57.978895 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:57.980079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7b10af27-8424-4b71-b42e-15505a5532be tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1668 microversion: 2.1 time: 0.149822 Jul 29 04:53:57.980745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 384/756] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:57 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:53:57.995002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 HTTP/1.1 Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:53:57.996864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:53:57.998400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '42dff02f-3754-41d5-85a6-d6e4e3a74922'} Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:53:57.999259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:53:58.000444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:53:58.001728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:53:58.001728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f4ecd5e4-247d-48c8-a456-5f607c2d74b4 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 404 len: 111 microversion: 2.1 time: 0.033579 Jul 29 04:53:58.001728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 373/757] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:53:57 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:53:58.006985 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b65149be-3d5a-4b83-83d4-074c675c858d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '.version_select at 0x7f3c543d29d0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:58.026816 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b65149be-3d5a-4b83-83d4-074c675c858d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388454543" status: 202 len: 0 microversion: 2.1 time: 0.023537 Jul 29 04:53:58.032062 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 385/758] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Jul 29 04:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388454543 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:53:58.723164 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:58.723666 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:58.729751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:58.730253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:58.731026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:58.731471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:58.810957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lazy-loading 'services' on Instance uuid 94d225e6-c457-47da-bb55-5620ad7f15e7 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:53:58.923951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1a36db9c-34a3-46ea-9401-d188c926a531 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments/b559c0c9-410c-4490-bd36-72f16630c3bc" status: 202 len: 0 microversion: 2.1 time: 0.204531 Jul 29 04:53:58.924630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 374/759] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:53:58 2022] DELETE /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments/b559c0c9-410c-4490-bd36-72f16630c3bc => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:53:58.934141 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4c694fc0-baeb-4644-88de-a6e1072cffaf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:58.936325 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4c694fc0-baeb-4644-88de-a6e1072cffaf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:53:58.947202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c694fc0-baeb-4644-88de-a6e1072cffaf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:58.947931 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c694fc0-baeb-4644-88de-a6e1072cffaf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:58.949770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c694fc0-baeb-4644-88de-a6e1072cffaf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:53:58.950213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c694fc0-baeb-4644-88de-a6e1072cffaf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:53:58.983747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4c694fc0-baeb-4644-88de-a6e1072cffaf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054661 Jul 29 04:53:58.984319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 386/760] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:53:58 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:53:59.997087 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9e33fb9f-8fc9-421a-82df-a0515abb59c0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:53:59.999341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9e33fb9f-8fc9-421a-82df-a0515abb59c0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:00.005537 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e33fb9f-8fc9-421a-82df-a0515abb59c0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:00.005992 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e33fb9f-8fc9-421a-82df-a0515abb59c0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:00.006774 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e33fb9f-8fc9-421a-82df-a0515abb59c0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:00.007219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9e33fb9f-8fc9-421a-82df-a0515abb59c0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:00.038383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9e33fb9f-8fc9-421a-82df-a0515abb59c0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046643 Jul 29 04:54:00.038943 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 375/761] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:53:59 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:54:00.102664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:00.103167 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:00.110659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:00.111103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:00.111870 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:00.112317 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:00.128365 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:00.141145 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Going to try to terminate instance {{(pid=129684) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:54:00.214228 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5b2d97f9-7dbe-4c9b-a7e5-ae79e3d0678f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 204 len: 0 microversion: 2.1 time: 0.115193 Jul 29 04:54:00.214812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 387/762] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:54:00 2022] DELETE /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:54:00.223134 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:00.223687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:00.229790 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:00.230785 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:00.231691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:00.232139 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:00.360663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:00.368171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-efc66576-8aff-4a7d-a206-1af03a8b46ea tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1683 microversion: 2.1 time: 0.149123 Jul 29 04:54:00.368782 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 376/763] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:00 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:01.390745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:01.391441 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:01.398063 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:01.398511 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:01.399268 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:01.399704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:01.603106 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:01.611423 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7ce5ade5-b16b-4c93-9bce-250d9c6b4573 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1683 microversion: 2.1 time: 0.225338 Jul 29 04:54:01.611996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 388/764] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:01 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:02.333488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-cd8041fa-52a8-4eed-b960-f562141eb49c req-fa0ff7c4-855d-4e3f-b5ca-d0dc0d15ee40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94d225e6-c457-47da-bb55-5620ad7f15e7", "name": "network-vif-deleted", "tag": "a62fbd73-0c26-4732-9cf9-7667cea10de3"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:02.346370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-cd8041fa-52a8-4eed-b960-f562141eb49c req-fa0ff7c4-855d-4e3f-b5ca-d0dc0d15ee40 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:02.347097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-cd8041fa-52a8-4eed-b960-f562141eb49c req-fa0ff7c4-855d-4e3f-b5ca-d0dc0d15ee40 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:02.361235 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-cd8041fa-52a8-4eed-b960-f562141eb49c req-fa0ff7c4-855d-4e3f-b5ca-d0dc0d15ee40 service nova] Creating event network-vif-deleted:a62fbd73-0c26-4732-9cf9-7667cea10de3 for instance 94d225e6-c457-47da-bb55-5620ad7f15e7 on hv-cinder-85144 Jul 29 04:54:02.366346 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-cd8041fa-52a8-4eed-b960-f562141eb49c req-fa0ff7c4-855d-4e3f-b5ca-d0dc0d15ee40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036609 Jul 29 04:54:02.366963 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 377/765] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:02.633428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:02.633996 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:02.640808 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:02.641272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:02.642042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:02.642488 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:02.675017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:02.675481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:02.675946 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lazy-loading 'fault' on Instance uuid 94d225e6-c457-47da-bb55-5620ad7f15e7 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:54:02.717220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:02.724568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ff9127f5-c475-4531-8f87-fe1c6b92c4b3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 200 len: 1332 microversion: 2.1 time: 0.095197 Jul 29 04:54:02.725155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 389/766] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:02 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:03.746142 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:03.746837 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:03.753545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:03.753993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:03.754754 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:03.755186 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:03.768659 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 HTTP/1.1 Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:54:03.770284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:54:03.771892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '94d225e6-c457-47da-bb55-5620ad7f15e7'} Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:54:03.772693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:54:03.773927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:03.775062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:54:03.775062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a15005c9-62fc-431f-98f2-5ae3f44b5449 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 404 len: 111 microversion: 2.1 time: 0.029756 Jul 29 04:54:03.775062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 378/767] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:03 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:54:03.781000 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-85bc2bc1-ae76-4c6e-8b79-6fe5cae260b5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '.version_select at 0x7f3c542d1c10>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:03.800173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-85bc2bc1-ae76-4c6e-8b79-6fe5cae260b5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755824665" status: 202 len: 0 microversion: 2.1 time: 0.023528 Jul 29 04:54:03.800775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 390/768] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Jul 29 04:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755824665 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:54:04.666455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9eec2bef-dcf9-4ad7-ae57-1ed293052579 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: .version_select at 0x7f3c58b538b0>, body: {"keypair": {"name": "tempest-keypair-509612079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxcd1xdh9KkmJlkobjj0oro5/xh1YdpFLMzxzJMVv5uKXmnl4ydM6oFfa13ZC7kjXYHBawAUoC8BtXX/bVzwc3uZo7nud/CNhK8yGhOH4sEL0igz69tL0jNQDaCNiuclg=="}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:04.681594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-9eec2bef-dcf9-4ad7-ae57-1ed293052579 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:54:04.685390 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-9eec2bef-dcf9-4ad7-ae57-1ed293052579 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:54:04.687732 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:04.709421 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9eec2bef-dcf9-4ad7-ae57-1ed293052579 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047151 Jul 29 04:54:04.710002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 379/769] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:54:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:05.923094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1628718539", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ca39e1-cfc7-4b5b-897b-220faf26ce68"}], "security_groups": [{"name": "tempest-securitygroup--161857742"}], "key_name": "tempest-keypair-509612079", "user_data": "}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:06.022717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] validate_networks() for [('21ca39e1-cfc7-4b5b-897b-220faf26ce68', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:54:06.432713 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:54:06.433725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:54:06.434210 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:54:06.434667 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:54:06.435184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:54:06.443947 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:06.444424 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:06.445269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:06.445718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:06.462704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:54:06.467175 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:54:06.478209 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:54:06.481301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:54:06.526362 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ad2627da-3cae-41a0-8f96-5e0db30366ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.608556 Jul 29 04:54:06.527538 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 391/770] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:54:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 04:54:06.539104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b982d331-0e0c-468a-9924-5cd6dd84798b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:06.539724 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b982d331-0e0c-468a-9924-5cd6dd84798b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:06.595658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b982d331-0e0c-468a-9924-5cd6dd84798b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:06.602434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b982d331-0e0c-468a-9924-5cd6dd84798b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1241 microversion: 2.1 time: 0.067791 Jul 29 04:54:06.603010 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 380/771] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:06 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:07.626028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:07.627746 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:07.630116 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:07.639162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:07.639876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:07.641083 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:07.642127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:07.734413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:07.742243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-865dc48e-1ff3-496b-a8c8-e50858255a64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1301 microversion: 2.1 time: 0.122366 Jul 29 04:54:07.743121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 392/772] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:07 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:54:08.766008 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:08.766623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:08.773368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:08.773834 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:08.774621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:08.775065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:08.933458 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:08.941158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d96bc4de-2687-4683-8dfd-43e60a05b1fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.180438 Jul 29 04:54:08.941873 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 381/773] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:08 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:09.353637 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-2e6b1455-5ac5-4109-bae4-782017d5e27b req-cd67064c-561d-4dd6-a0b5-a7703331bbef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88854861-a8db-44a2-839b-5e158363e71c", "tag": "afe03d9b-8522-41fb-a4a6-5dca887a6299"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:09.366874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-2e6b1455-5ac5-4109-bae4-782017d5e27b req-cd67064c-561d-4dd6-a0b5-a7703331bbef service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:09.367388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-2e6b1455-5ac5-4109-bae4-782017d5e27b req-cd67064c-561d-4dd6-a0b5-a7703331bbef service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:09.380819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-2e6b1455-5ac5-4109-bae4-782017d5e27b req-cd67064c-561d-4dd6-a0b5-a7703331bbef service nova] Creating event network-changed:afe03d9b-8522-41fb-a4a6-5dca887a6299 for instance 88854861-a8db-44a2-839b-5e158363e71c on hv-cinder-85144 Jul 29 04:54:09.387582 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-2e6b1455-5ac5-4109-bae4-782017d5e27b req-cd67064c-561d-4dd6-a0b5-a7703331bbef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037437 Jul 29 04:54:09.388294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 393/774] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:09.963173 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:09.963760 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:09.970274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:09.970780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:09.971575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:09.972195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:10.098856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:10.106780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9ea3af16-acdd-4563-a241-641084f4e5a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.147431 Jul 29 04:54:10.107342 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 382/775] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:09 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:11.128007 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:11.128744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:11.135153 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:11.135603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:11.137192 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:11.137628 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:11.267569 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:11.274988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a4bcbc6b-2014-4d24-b914-6fb2fd922e9c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.151382 Jul 29 04:54:11.275544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 394/776] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:11 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:12.296523 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:12.297175 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:12.303814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:12.304265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:12.305070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:12.305513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:12.431536 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:12.439667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-06b41377-253d-4be7-8e60-f035a244bc0f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.147720 Jul 29 04:54:12.440226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 383/777] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:12 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:13.459565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:13.460181 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:13.466844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:13.467288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:13.468041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:13.468473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:13.594351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:13.601683 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6883cac4-b68a-4d53-bafb-fa07de1212c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.146277 Jul 29 04:54:13.602243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 395/778] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:13 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:14.622594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:14.623196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:14.629577 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:14.630025 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:14.630776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:14.631210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:14.762183 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:14.769524 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-837458a6-f357-467d-a0a4-b9a574ad0114 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.150781 Jul 29 04:54:14.770121 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 384/779] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:14 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:15.791433 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:15.792714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:15.799134 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:15.799584 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:15.800347 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:15.800814 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:15.850356 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-cc83a9f8-7368-4e35-b932-94925311da16 req-91e524ce-5d53-4bd5-bfff-27a3e88982eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88854861-a8db-44a2-839b-5e158363e71c", "name": "network-vif-plugged", "status": "completed", "tag": "afe03d9b-8522-41fb-a4a6-5dca887a6299"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:15.860593 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-cc83a9f8-7368-4e35-b932-94925311da16 req-91e524ce-5d53-4bd5-bfff-27a3e88982eb service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:15.861093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-cc83a9f8-7368-4e35-b932-94925311da16 req-91e524ce-5d53-4bd5-bfff-27a3e88982eb service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:15.872938 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-cc83a9f8-7368-4e35-b932-94925311da16 req-91e524ce-5d53-4bd5-bfff-27a3e88982eb service nova] Creating event network-vif-plugged:afe03d9b-8522-41fb-a4a6-5dca887a6299 for instance 88854861-a8db-44a2-839b-5e158363e71c on hv-cinder-85144 Jul 29 04:54:15.878250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-cc83a9f8-7368-4e35-b932-94925311da16 req-91e524ce-5d53-4bd5-bfff-27a3e88982eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 Jul 29 04:54:15.879389 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 385/780] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:15.942595 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:15.950699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-96bbcff8-c5c5-474f-8536-b96d6ad549c9 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.163658 Jul 29 04:54:15.951260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 396/781] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:15 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:16.973229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:16.973853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:16.975747 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:16.982757 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:16.983206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:16.983964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:16.984402 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:17.114475 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:17.122915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c990b32a-feed-4fbd-8c9a-787e908efc85 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1366 microversion: 2.1 time: 0.154045 Jul 29 04:54:17.123474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 386/782] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:16 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:18.144770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:18.145390 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:18.147339 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:18.147995 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:18.154908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:18.155365 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:18.156133 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:18.156579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:18.281887 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:18.289216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9cfe73a8-f45d-40b0-8634-251e5d0d414b tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1555 microversion: 2.1 time: 0.148327 Jul 29 04:54:18.289781 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 397/783] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:54:18 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:18.310117 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d7b69bd2-cf88-419d-81ce-e9fa39300e97 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:18.310609 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d7b69bd2-cf88-419d-81ce-e9fa39300e97 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:18.317002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7b69bd2-cf88-419d-81ce-e9fa39300e97 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:18.317449 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7b69bd2-cf88-419d-81ce-e9fa39300e97 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:18.318199 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7b69bd2-cf88-419d-81ce-e9fa39300e97 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:18.318632 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d7b69bd2-cf88-419d-81ce-e9fa39300e97 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:18.402622 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d7b69bd2-cf88-419d-81ce-e9fa39300e97 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096482 Jul 29 04:54:18.403215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 387/784] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:54:18 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:19.315536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-41b02808-c371-4b2c-8767-efcb4ab57f37 req-2016059a-5052-484d-8fc7-70d211b444a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88854861-a8db-44a2-839b-5e158363e71c", "tag": "afe03d9b-8522-41fb-a4a6-5dca887a6299"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:19.325326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-41b02808-c371-4b2c-8767-efcb4ab57f37 req-2016059a-5052-484d-8fc7-70d211b444a9 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:19.325766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-41b02808-c371-4b2c-8767-efcb4ab57f37 req-2016059a-5052-484d-8fc7-70d211b444a9 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:19.336850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-41b02808-c371-4b2c-8767-efcb4ab57f37 req-2016059a-5052-484d-8fc7-70d211b444a9 service nova] Creating event network-changed:afe03d9b-8522-41fb-a4a6-5dca887a6299 for instance 88854861-a8db-44a2-839b-5e158363e71c on hv-cinder-85144 Jul 29 04:54:19.342671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-41b02808-c371-4b2c-8767-efcb4ab57f37 req-2016059a-5052-484d-8fc7-70d211b444a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031363 Jul 29 04:54:19.343288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 398/785] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:32.899739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:32.900592 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:33.005610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d9b84b31-d960-4d75-aa51-e4047bae0ac6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:33.006210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d9b84b31-d960-4d75-aa51-e4047bae0ac6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:33.014024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9b84b31-d960-4d75-aa51-e4047bae0ac6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:33.014567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9b84b31-d960-4d75-aa51-e4047bae0ac6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:33.015428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9b84b31-d960-4d75-aa51-e4047bae0ac6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:33.015958 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9b84b31-d960-4d75-aa51-e4047bae0ac6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:33.050989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d9b84b31-d960-4d75-aa51-e4047bae0ac6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments/7b6bde30-17b6-4547-8099-fb993b1ade8b" status: 200 len: 194 microversion: 2.20 time: 0.152988 Jul 29 04:54:33.051647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 388/786] 10.222.0.40 () {60 vars in 1454 bytes} [Fri Jul 29 04:54:32 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments/7b6bde30-17b6-4547-8099-fb993b1ade8b => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:54:33.117658 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=13 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:33.118429 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:33.122833 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:33.123412 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:33.130800 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:33.131248 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:33.132009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:33.132443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:33.222854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lazy-loading 'services' on Instance uuid 630ff067-c10b-4ae9-8d92-c40d206fd0ca {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:54:33.294817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5372cad1-b1ee-44a9-9b75-7b87d5270ac1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments/7b6bde30-17b6-4547-8099-fb993b1ade8b" status: 202 len: 0 microversion: 2.20 time: 0.178251 Jul 29 04:54:33.295563 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 399/787] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Jul 29 04:54:33 2022] DELETE /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments/7b6bde30-17b6-4547-8099-fb993b1ade8b => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:54:33.305006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8535155d-abac-4306-84fb-35ff7fc7929a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:33.307272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8535155d-abac-4306-84fb-35ff7fc7929a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:33.314840 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8535155d-abac-4306-84fb-35ff7fc7929a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:33.316370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8535155d-abac-4306-84fb-35ff7fc7929a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:33.317612 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8535155d-abac-4306-84fb-35ff7fc7929a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:33.318064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8535155d-abac-4306-84fb-35ff7fc7929a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:33.353769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8535155d-abac-4306-84fb-35ff7fc7929a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053749 Jul 29 04:54:33.354496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 389/788] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Jul 29 04:54:33 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:54:34.367330 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-157101f6-648d-4110-8804-a18e6c53e877 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:34.369626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-157101f6-648d-4110-8804-a18e6c53e877 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:34.376674 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-157101f6-648d-4110-8804-a18e6c53e877 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:34.377090 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-157101f6-648d-4110-8804-a18e6c53e877 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:34.377851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-157101f6-648d-4110-8804-a18e6c53e877 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:34.378282 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-157101f6-648d-4110-8804-a18e6c53e877 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:34.409479 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-157101f6-648d-4110-8804-a18e6c53e877 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046935 Jul 29 04:54:34.410252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 400/789] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Jul 29 04:54:34 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:54:34.473951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:34.474568 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:34.481922 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:34.482374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:34.483143 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:34.483584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:34.512877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:54:34.594117 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-10668a7d-8e93-431d-ba3c-2b06f3bc81de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 204 len: 0 microversion: 2.20 time: 0.124567 Jul 29 04:54:34.594869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 390/790] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Jul 29 04:54:34 2022] DELETE /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 04:54:34.603734 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:34.604427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:34.611302 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:34.611755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:34.612540 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:34.613030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:34.761180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:34.769207 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:34.770715 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:34.771874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e4a7ac95-b982-40be-b474-e88f83c907ce tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.172463 Jul 29 04:54:34.772433 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 401/791] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:34 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:35.796471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:35.797206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:35.804370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:35.804972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:35.805919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:35.806408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:35.943892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:35.953179 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:35.954932 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:35.956141 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-533538a3-4879-491f-9c57-4f629b89a308 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.164009 Jul 29 04:54:35.956723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 391/792] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:35 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:36.979253 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:36.979916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:36.986597 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:36.987048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:36.987819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:36.988259 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:37.227763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:37.236446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:37.238001 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:37.239163 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-99ccac77-9b96-4ccc-9279-0555e055f40f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1723 microversion: 2.20 time: 0.263971 Jul 29 04:54:37.239731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 402/793] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:36 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:37.733628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-842461a3-a7ef-4ed3-adc1-365f0a016490 req-55d02b30-67a8-4780-b7b5-274a48a7bcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630ff067-c10b-4ae9-8d92-c40d206fd0ca", "name": "network-vif-deleted", "tag": "1f4eb45a-ea71-4ede-b569-032c9dddfac4"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:37.745375 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-842461a3-a7ef-4ed3-adc1-365f0a016490 req-55d02b30-67a8-4780-b7b5-274a48a7bcdd service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:37.746209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-842461a3-a7ef-4ed3-adc1-365f0a016490 req-55d02b30-67a8-4780-b7b5-274a48a7bcdd service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:37.759407 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-842461a3-a7ef-4ed3-adc1-365f0a016490 req-55d02b30-67a8-4780-b7b5-274a48a7bcdd service nova] Creating event network-vif-deleted:1f4eb45a-ea71-4ede-b569-032c9dddfac4 for instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca on hv-cinder-85144 Jul 29 04:54:37.766945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-842461a3-a7ef-4ed3-adc1-365f0a016490 req-55d02b30-67a8-4780-b7b5-274a48a7bcdd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036600 Jul 29 04:54:37.768067 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 392/794] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:38.264007 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:38.264638 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:38.271102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:38.271864 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:38.272917 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:38.273366 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:38.312381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:38.312957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:38.313420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lazy-loading 'fault' on Instance uuid 630ff067-c10b-4ae9-8d92-c40d206fd0ca {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:54:38.360382 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:38.370553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:38.372899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:38.375079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-853bf816-6ace-43d8-bb0b-637f22dee053 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 200 len: 1372 microversion: 2.20 time: 0.115557 Jul 29 04:54:38.375723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 403/795] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:38 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:39.401243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:39.401948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:39.409133 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:39.409586 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:39.410352 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:39.410791 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:39.425210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] HTTP exception thrown: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Request method failure captured: Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca HTTP/1.1 Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42bXeWyCQfOtOEH09FiVyGiCoQLFYQn54ZEIsEZwxX7cn90tFIL2-8f5ZJ4BQeCCeqZ666MG2b61ZEz4JSZsrIsxqCWTFXOrcMR706aVGIy2fluNOozK1CzwUakRiGQsYpv3qa7iCuK3Lus4NsO8Cm5tsBYh39nyl0vX-yph8ZVsHXE Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:54:39.426864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: a1e1c24849d7480b8ac804a7e3d2ab5a Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 04:54:39.428521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '630ff067-c10b-4ae9-8d92-c40d206fd0ca'} Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:54:39.429650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 04:54:39.431112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:39.432751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Returning 404 to user: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:54:39.432751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-87447924-12aa-494d-9851-4ad0cc6ff93d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 404 len: 111 microversion: 2.20 time: 0.031389 Jul 29 04:54:39.432751 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 393/796] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:39 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 04:54:39.437228 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7390100f-2929-48e0-98f6-d56a9884c466 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '.version_select at 0x7f3c5419c550>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:39.456853 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7390100f-2929-48e0-98f6-d56a9884c466 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015974218" status: 204 len: 0 microversion: 2.20 time: 0.023409 Jul 29 04:54:39.457437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 404/797] 10.222.0.40 () {60 vars in 1262 bytes} [Fri Jul 29 04:54:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015974218 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 29 04:54:40.116924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b1d6dfb2-0221-4111-9f39-6e08407bdfc6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'create', calling method: .version_select at 0x7f3c58b2e1f0>, body: {"keypair": {"name": "tempest-keypair-434988108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOhX/J43n/Czs4O6vUaed96EH0isfHpg0SSITvjAMWCmqojsefIU/XGQFpRai+NILaVgmHzS5HnKiOc9PpTEKEu2D9rnYda/kCskkN7BcuzKiv+yO197VHCSARuHNdb2w=="}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:40.132708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-b1d6dfb2-0221-4111-9f39-6e08407bdfc6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for project f8e9e21d168140e99ffed71146e35fc4. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:54:40.136529 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-b1d6dfb2-0221-4111-9f39-6e08407bdfc6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for user a1e1c24849d7480b8ac804a7e3d2ab5a and project f8e9e21d168140e99ffed71146e35fc4. Resources: {'key_pairs'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:54:40.158570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b1d6dfb2-0221-4111-9f39-6e08407bdfc6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045590 Jul 29 04:54:40.159165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 394/798] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Jul 29 04:54:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 04:54:41.405012 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-697096457", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8994c62-2968-491e-9d89-ada7a08f8ea0"}], "security_groups": [{"name": "tempest-securitygroup--1384213129"}], "key_name": "tempest-keypair-434988108", "user_data": "}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:41.505102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] validate_networks() for [('c8994c62-2968-491e-9d89-ada7a08f8ea0', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:54:41.867587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:54:41.868016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:54:41.868503 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:54:41.868951 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:54:41.869377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:54:41.879066 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:41.879526 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:41.880339 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:41.880825 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:41.898242 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for project f8e9e21d168140e99ffed71146e35fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:54:41.902103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Getting quotas for user a1e1c24849d7480b8ac804a7e3d2ab5a and project f8e9e21d168140e99ffed71146e35fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:54:41.912756 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:54:41.915262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:54:41.960683 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9e3b450a-a183-454a-8dff-1a6a22878a3a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.561173 Jul 29 04:54:41.961331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 405/799] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Jul 29 04:54:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 04:54:41.972810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-731b838a-f2aa-40d4-bd74-37e518b9670b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:41.973429 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-731b838a-f2aa-40d4-bd74-37e518b9670b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:42.032070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-731b838a-f2aa-40d4-bd74-37e518b9670b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:42.039533 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-731b838a-f2aa-40d4-bd74-37e518b9670b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:42.041357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-731b838a-f2aa-40d4-bd74-37e518b9670b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:42.042499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-731b838a-f2aa-40d4-bd74-37e518b9670b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1280 microversion: 2.20 time: 0.074034 Jul 29 04:54:42.043546 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 395/800] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:41 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:43.067310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:43.068561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:43.076939 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:43.077596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:43.078599 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:43.079060 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:43.147872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:43.156403 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:43.157999 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:43.159135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6cecd655-69ae-4f3d-8a8d-200655aaf00d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1338 microversion: 2.20 time: 0.096317 Jul 29 04:54:43.159759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 406/801] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:43 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:44.188854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:44.190080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:44.197915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:44.198369 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:44.199157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:44.200440 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:44.344482 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:44.353807 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:44.355882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:44.357359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-383145f2-8d17-4cb7-89b9-24a18f0f6b69 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1406 microversion: 2.20 time: 0.179657 Jul 29 04:54:44.358007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 396/802] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:44 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:44.416398 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-d4874c4d-72be-4827-8461-f8ac6935d130 req-5666b186-3a8c-4f1d-bb8b-bf6d25d6c428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e997be3-f342-420b-8630-ca1f8847303a", "tag": "89c67e7e-2b75-46a8-b24e-d4b2cd7a0832"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:44.428351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-d4874c4d-72be-4827-8461-f8ac6935d130 req-5666b186-3a8c-4f1d-bb8b-bf6d25d6c428 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:44.428859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-d4874c4d-72be-4827-8461-f8ac6935d130 req-5666b186-3a8c-4f1d-bb8b-bf6d25d6c428 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:44.448277 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-d4874c4d-72be-4827-8461-f8ac6935d130 req-5666b186-3a8c-4f1d-bb8b-bf6d25d6c428 service nova] Creating event network-changed:89c67e7e-2b75-46a8-b24e-d4b2cd7a0832 for instance 5e997be3-f342-420b-8630-ca1f8847303a on hv-cinder-85144 Jul 29 04:54:44.453751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-d4874c4d-72be-4827-8461-f8ac6935d130 req-5666b186-3a8c-4f1d-bb8b-bf6d25d6c428 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041425 Jul 29 04:54:44.456841 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 407/803] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:45.380651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:45.381261 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:45.387929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:45.388368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:45.389167 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:45.389606 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:45.525333 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:45.533918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:45.535446 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:45.536559 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f2cf5ae7-ca67-4cbe-84a5-8d2752c57749 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1406 microversion: 2.20 time: 0.159874 Jul 29 04:54:45.537146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 397/804] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:45 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:46.561815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:46.562567 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:46.569195 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:46.569655 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:46.570427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:46.570875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:46.931169 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:46.939848 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:46.941416 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:46.942532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-93261b3c-0afd-4420-b474-c78a45e00477 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1406 microversion: 2.20 time: 0.386554 Jul 29 04:54:46.943091 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 408/805] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:46 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:47.965208 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:47.965822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:47.973336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:47.973861 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:47.974712 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:47.975415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:48.114353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:48.122330 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:48.124427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:48.125573 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-25ca8517-62c2-487e-8761-399dda29fe73 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1406 microversion: 2.20 time: 0.164282 Jul 29 04:54:48.126128 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 398/806] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:47 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:49.148260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:49.148931 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:49.155774 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:49.156228 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:49.157028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:49.157471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:49.288705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:49.296862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:49.298376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:49.299483 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c7b3a902-9c26-42a6-8127-6bce553410de tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1406 microversion: 2.20 time: 0.155157 Jul 29 04:54:49.300049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 409/807] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:49 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:49.969270 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-609611d4-8d55-461b-8e1b-ef6fc3751c73 req-2c6024e4-b502-42ae-92c2-6aec7b6ff3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e997be3-f342-420b-8630-ca1f8847303a", "name": "network-vif-plugged", "status": "completed", "tag": "89c67e7e-2b75-46a8-b24e-d4b2cd7a0832"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:49.979928 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-609611d4-8d55-461b-8e1b-ef6fc3751c73 req-2c6024e4-b502-42ae-92c2-6aec7b6ff3fc service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:49.980374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-609611d4-8d55-461b-8e1b-ef6fc3751c73 req-2c6024e4-b502-42ae-92c2-6aec7b6ff3fc service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:49.991904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-609611d4-8d55-461b-8e1b-ef6fc3751c73 req-2c6024e4-b502-42ae-92c2-6aec7b6ff3fc service nova] Creating event network-vif-plugged:89c67e7e-2b75-46a8-b24e-d4b2cd7a0832 for instance 5e997be3-f342-420b-8630-ca1f8847303a on hv-cinder-85144 Jul 29 04:54:49.997030 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-609611d4-8d55-461b-8e1b-ef6fc3751c73 req-2c6024e4-b502-42ae-92c2-6aec7b6ff3fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039237 Jul 29 04:54:49.997571 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 399/808] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:54:50.321601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:50.322281 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:50.329387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:50.329848 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:50.330661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:50.331133 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:50.460670 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:50.468550 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:50.470013 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:50.471112 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-396ce175-814f-43fc-afd2-fa66824f779f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1406 microversion: 2.20 time: 0.153560 Jul 29 04:54:50.471675 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 410/809] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:50 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:51.495025 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:51.495718 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:51.502957 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:51.503437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:51.504210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:51.504725 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:51.635382 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:51.644053 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:51.645655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:51.647927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4ede8818-b02d-4105-8200-7eedefedf0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1406 microversion: 2.20 time: 0.157591 Jul 29 04:54:51.648745 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 400/810] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:51 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:52.672024 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:52.672588 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:52.674975 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:52.675634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:52.681581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:52.682040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:52.682815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:52.683262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:52.814442 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:52.822317 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:52.823820 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:54:52.825002 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b4a5ede8-5d54-4342-94a6-2c1fe59368c8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1596 microversion: 2.20 time: 0.156911 Jul 29 04:54:52.825564 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 411/811] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:54:52 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1596 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:54:52.847449 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9673c0b1-7d9d-4214-aec1-43b6fcf80d10 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:52.848020 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9673c0b1-7d9d-4214-aec1-43b6fcf80d10 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:52.849926 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:54:52.855489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9673c0b1-7d9d-4214-aec1-43b6fcf80d10 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:52.855940 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9673c0b1-7d9d-4214-aec1-43b6fcf80d10 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:52.856735 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9673c0b1-7d9d-4214-aec1-43b6fcf80d10 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:52.857174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9673c0b1-7d9d-4214-aec1-43b6fcf80d10 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:52.940178 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9673c0b1-7d9d-4214-aec1-43b6fcf80d10 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096693 Jul 29 04:54:52.940810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 401/812] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Jul 29 04:54:52 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:54:53.886464 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-3aaf88e0-c28c-4b62-9e76-5fd32e8c8103 req-e02c1781-c802-4570-aef8-a368aaff8734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e997be3-f342-420b-8630-ca1f8847303a", "tag": "89c67e7e-2b75-46a8-b24e-d4b2cd7a0832"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:53.896568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-3aaf88e0-c28c-4b62-9e76-5fd32e8c8103 req-e02c1781-c802-4570-aef8-a368aaff8734 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:53.897055 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-3aaf88e0-c28c-4b62-9e76-5fd32e8c8103 req-e02c1781-c802-4570-aef8-a368aaff8734 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:53.908577 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-3aaf88e0-c28c-4b62-9e76-5fd32e8c8103 req-e02c1781-c802-4570-aef8-a368aaff8734 service nova] Creating event network-changed:89c67e7e-2b75-46a8-b24e-d4b2cd7a0832 for instance 5e997be3-f342-420b-8630-ca1f8847303a on hv-cinder-85144 Jul 29 04:54:53.913635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-3aaf88e0-c28c-4b62-9e76-5fd32e8c8103 req-e02c1781-c802-4570-aef8-a368aaff8734 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030810 Jul 29 04:54:53.914251 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 412/813] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:55.830624 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-695076605"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:55.831180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:55.837148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:55.837614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:55.838355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:55.838787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:55.967966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.network.security_group_api [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Removing security group 9d2ad824-5001-497b-afa2-545b0f5f4ab0 from port 74c48b51-41ba-4b30-aaba-fd0d90c6f624 Jul 29 04:54:56.298776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ec31442c-3836-48c9-a40f-35d93755832b tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/action" status: 202 len: 0 microversion: 2.1 time: 0.473390 Jul 29 04:54:56.303419 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 402/814] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 04:54:55 2022] POST /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:54:56.316100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-7b86aa12-10aa-428d-881a-6a45331418e3 req-98cc31d9-36fd-41e4-9530-b4d683733f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393b1a3-209a-4a5f-bc1f-82d40c318516", "tag": "74c48b51-41ba-4b30-aaba-fd0d90c6f624"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:56.346759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-7b86aa12-10aa-428d-881a-6a45331418e3 req-98cc31d9-36fd-41e4-9530-b4d683733f3f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:56.349522 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-7b86aa12-10aa-428d-881a-6a45331418e3 req-98cc31d9-36fd-41e4-9530-b4d683733f3f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:56.374439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-7b86aa12-10aa-428d-881a-6a45331418e3 req-98cc31d9-36fd-41e4-9530-b4d683733f3f service nova] Creating event network-changed:74c48b51-41ba-4b30-aaba-fd0d90c6f624 for instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 on hv-cinder-85144 Jul 29 04:54:56.380406 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-7b86aa12-10aa-428d-881a-6a45331418e3 req-98cc31d9-36fd-41e4-9530-b4d683733f3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072660 Jul 29 04:54:56.381565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 413/815] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:57.716064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:57.716629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:57.723609 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:57.724073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:57.724887 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:57.725341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:57.806087 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lazy-loading 'services' on Instance uuid 5393b1a3-209a-4a5f-bc1f-82d40c318516 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:54:57.879610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3eb2b55f-a899-4465-8526-c54b510d7f10 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments/427075d2-2f94-438f-bca0-1d00b5624132" status: 202 len: 0 microversion: 2.1 time: 0.167800 Jul 29 04:54:57.880302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 403/816] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:54:57 2022] DELETE /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments/427075d2-2f94-438f-bca0-1d00b5624132 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:54:57.890663 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f65813ac-9132-4bc8-932c-0bc3c8dfe896 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:57.893094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f65813ac-9132-4bc8-932c-0bc3c8dfe896 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:57.900009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f65813ac-9132-4bc8-932c-0bc3c8dfe896 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:57.901003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f65813ac-9132-4bc8-932c-0bc3c8dfe896 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:57.902705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f65813ac-9132-4bc8-932c-0bc3c8dfe896 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:57.903620 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f65813ac-9132-4bc8-932c-0bc3c8dfe896 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:57.938809 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f65813ac-9132-4bc8-932c-0bc3c8dfe896 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053740 Jul 29 04:54:57.939667 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 414/817] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:54:57 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:58.395720 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-173e6bc3-9fb8-4c31-bcbb-92f1dfad0e5a req-22150f18-5239-4523-95a5-c1e89e0ab3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5393b1a3-209a-4a5f-bc1f-82d40c318516", "tag": "74c48b51-41ba-4b30-aaba-fd0d90c6f624"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:54:58.407038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-173e6bc3-9fb8-4c31-bcbb-92f1dfad0e5a req-22150f18-5239-4523-95a5-c1e89e0ab3f7 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:58.407549 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-173e6bc3-9fb8-4c31-bcbb-92f1dfad0e5a req-22150f18-5239-4523-95a5-c1e89e0ab3f7 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:58.419109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-173e6bc3-9fb8-4c31-bcbb-92f1dfad0e5a req-22150f18-5239-4523-95a5-c1e89e0ab3f7 service nova] Creating event network-changed:74c48b51-41ba-4b30-aaba-fd0d90c6f624 for instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 on hv-cinder-85144 Jul 29 04:54:58.425009 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-173e6bc3-9fb8-4c31-bcbb-92f1dfad0e5a req-22150f18-5239-4523-95a5-c1e89e0ab3f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033276 Jul 29 04:54:58.425594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 404/818] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:54:58.951247 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ca854b2c-5090-4ff4-ad88-12bc6a87e1a7 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:58.954276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ca854b2c-5090-4ff4-ad88-12bc6a87e1a7 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:58.963139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca854b2c-5090-4ff4-ad88-12bc6a87e1a7 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:58.964769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca854b2c-5090-4ff4-ad88-12bc6a87e1a7 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:58.965593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca854b2c-5090-4ff4-ad88-12bc6a87e1a7 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:58.966040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca854b2c-5090-4ff4-ad88-12bc6a87e1a7 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:58.996241 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ca854b2c-5090-4ff4-ad88-12bc6a87e1a7 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049036 Jul 29 04:54:58.996835 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 415/819] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:54:58 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:54:59.009320 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:54:59.009929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:54:59.016829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:59.017276 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:59.018043 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:54:59.018476 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:54:59.094988 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] HTTP exception thrown: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 is not attached to volume 427075d2-2f94-438f-bca0-1d00b5624132 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Request method failure captured: Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: DELETE /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments/427075d2-2f94-438f-bca0-1d00b5624132 HTTP/1.1 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42co5gRpRfm9QSKHYBN951z-7uWSgsWjHYXtgFTAM7LBh9P0lqYKvPgVlmH2cHyr1QxP0ZonxgdGT35Je1TKrsPPZzQObt7LWnx-NqZUpoLx3C5eo3evxhblwM0F42wxYdJ8ArrdaHdQq0mR9MakgwValTHa2-eLjqIOXVfPOJhYj-0 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 21c0f0b9063948a9a0183b528bc21130 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-TestMinimumBasicScenario-1161342934 Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:54:59.097626 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-TestMinimumBasicScenario-1161342934 Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 21c0f0b9063948a9a0183b528bc21130 Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1161342934 Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-TestMinimumBasicScenario-1161342934-project Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 11f44b37b46b4793944285bee7b8427e Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-TestMinimumBasicScenario-1161342934-project Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:54:59.099945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 is not attached to volume 427075d2-2f94-438f-bca0-1d00b5624132 Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'server_id': '5393b1a3-209a-4a5f-bc1f-82d40c318516', 'id': '427075d2-2f94-438f-bca0-1d00b5624132'} Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 427075d2-2f94-438f-bca0-1d00b5624132. Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:54:59.101355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 is not attached to volume 427075d2-2f94-438f-bca0-1d00b5624132 Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 is not attached to volume 427075d2-2f94-438f-bca0-1d00b5624132 Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:54:59.103545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Returning 404 to user: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 is not attached to volume 427075d2-2f94-438f-bca0-1d00b5624132 {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:54:59.105215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3302969a-6ea9-4b66-a390-80fd70cd4760 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments/427075d2-2f94-438f-bca0-1d00b5624132" status: 404 len: 154 microversion: 2.1 time: 0.094703 Jul 29 04:54:59.105215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 405/820] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:54:59 2022] DELETE /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516/os-volume_attachments/427075d2-2f94-438f-bca0-1d00b5624132 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:55:00.237509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:00.238004 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:00.244569 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:00.245044 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:00.245823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:00.246256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:00.271150 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Going to try to terminate instance {{(pid=129684) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:55:00.314478 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:00.345055 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6344308e-e062-4ece-85bb-0bbbf43d9957 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 204 len: 0 microversion: 2.1 time: 0.110993 Jul 29 04:55:00.345812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 416/821] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:55:00 2022] DELETE /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:55:00.354697 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:00.355310 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:00.362337 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:00.362937 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:00.363810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:00.364254 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:00.491600 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:00.499987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-59c2aa59-84f5-42d3-89a8-288e91c96051 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1552 microversion: 2.1 time: 0.149057 Jul 29 04:55:00.500549 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 406/822] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:00 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:01.522567 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:01.523276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:01.529914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:01.530906 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:01.531676 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:01.532118 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:01.662723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:01.670526 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6cb6353f-d8d0-410e-acb8-5689efc403be tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1552 microversion: 2.1 time: 0.152313 Jul 29 04:55:01.671116 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 417/823] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:01 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:02.691373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:02.692024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:02.698566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:02.699019 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:02.699779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:02.700215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:02.718600 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:02.834498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f44b37b46b4793944285bee7b8427e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0f0b9063948a9a0183b528bc21130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:02.841990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fb2277e8-7676-4644-8fa7-c6a69f55efbd tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 200 len: 1552 microversion: 2.1 time: 0.154473 Jul 29 04:55:02.843403 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 407/824] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:02 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:03.236279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-9663b389-1f8b-40d2-b7ed-f4b7fa91fec8 req-edf45bae-9f2b-46f1-a961-ef5813ee7728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5393b1a3-209a-4a5f-bc1f-82d40c318516", "name": "network-vif-deleted", "tag": "74c48b51-41ba-4b30-aaba-fd0d90c6f624"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:03.242076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:03.247745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9663b389-1f8b-40d2-b7ed-f4b7fa91fec8 req-edf45bae-9f2b-46f1-a961-ef5813ee7728 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:03.248190 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9663b389-1f8b-40d2-b7ed-f4b7fa91fec8 req-edf45bae-9f2b-46f1-a961-ef5813ee7728 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:03.261581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-9663b389-1f8b-40d2-b7ed-f4b7fa91fec8 req-edf45bae-9f2b-46f1-a961-ef5813ee7728 service nova] Creating event network-vif-deleted:74c48b51-41ba-4b30-aaba-fd0d90c6f624 for instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 on hv-cinder-85144 Jul 29 04:55:03.269369 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-9663b389-1f8b-40d2-b7ed-f4b7fa91fec8 req-edf45bae-9f2b-46f1-a961-ef5813ee7728 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036821 Jul 29 04:55:03.269978 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 418/825] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:03.864965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:03.865520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] [instance: 5393b1a3-209a-4a5f-bc1f-82d40c318516] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:03.867821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:03.883678 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:03.884130 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:03.884938 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:03.885378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:03.900221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] HTTP exception thrown: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 could not be found. Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Request method failure captured: Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 HTTP/1.1 Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42co5gRpRfm9QSKHYBN951z-7uWSgsWjHYXtgFTAM7LBh9P0lqYKvPgVlmH2cHyr1QxP0ZonxgdGT35Je1TKrsPPZzQObt7LWnx-NqZUpoLx3C5eo3evxhblwM0F42wxYdJ8ArrdaHdQq0mR9MakgwValTHa2-eLjqIOXVfPOJhYj-0 Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 21c0f0b9063948a9a0183b528bc21130 Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-TestMinimumBasicScenario-1161342934 Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:55:03.901779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/21c0f0b9063948a9a0183b528bc21130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-TestMinimumBasicScenario-1161342934 Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 21c0f0b9063948a9a0183b528bc21130 Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1161342934 Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-TestMinimumBasicScenario-1161342934-project Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 11f44b37b46b4793944285bee7b8427e Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-TestMinimumBasicScenario-1161342934-project Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 could not be found. Jul 29 04:55:03.903347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '5393b1a3-209a-4a5f-bc1f-82d40c318516'} Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 could not be found. Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:55:03.904423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 could not be found. Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 could not be found. Jul 29 04:55:03.906567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:03.908043 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Returning 404 to user: Instance 5393b1a3-209a-4a5f-bc1f-82d40c318516 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:55:03.908043 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3d1a97da-6c8a-40c2-8aff-91b49d2e26e0 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516" status: 404 len: 111 microversion: 2.1 time: 0.042341 Jul 29 04:55:03.908043 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 408/826] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:03 2022] GET /compute/v2.1/servers/5393b1a3-209a-4a5f-bc1f-82d40c318516 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:55:03.913266 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-19cb649e-a201-476b-86f1-c7136fdd8f00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] Calling method '.version_select at 0x7f3c543bdca0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:03.931326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-19cb649e-a201-476b-86f1-c7136fdd8f00 tempest-TestMinimumBasicScenario-1161342934 tempest-TestMinimumBasicScenario-1161342934-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-884405679" status: 202 len: 0 microversion: 2.1 time: 0.022505 Jul 29 04:55:03.931885 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 419/827] 10.222.0.40 () {58 vars in 1269 bytes} [Fri Jul 29 04:55:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-884405679 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:55:04.205918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:04.206384 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:04.212857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:04.213317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:04.214100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:04.214545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:04.300368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lazy-loading 'services' on Instance uuid f027c23f-8c17-419b-80a0-bdb62b416da3 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:55:04.376252 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9ee0543e-e200-4067-9741-f8e2ad06fec9 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments/b6f87a6b-233b-4272-952f-f1c6abc09968" status: 202 len: 0 microversion: 2.1 time: 0.174719 Jul 29 04:55:04.376872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 409/828] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:55:04 2022] DELETE /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments/b6f87a6b-233b-4272-952f-f1c6abc09968 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:55:04.385982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-961867e6-fc18-4279-8db3-b0e0e715501c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:04.388572 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-961867e6-fc18-4279-8db3-b0e0e715501c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:04.396591 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-961867e6-fc18-4279-8db3-b0e0e715501c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:04.397914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-961867e6-fc18-4279-8db3-b0e0e715501c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:04.398792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-961867e6-fc18-4279-8db3-b0e0e715501c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:04.399237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-961867e6-fc18-4279-8db3-b0e0e715501c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:04.431782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-961867e6-fc18-4279-8db3-b0e0e715501c tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050471 Jul 29 04:55:04.432428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 420/829] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:55:04 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:05.446059 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ea7716d6-3b26-42df-811f-83f5eafb8d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:05.448422 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ea7716d6-3b26-42df-811f-83f5eafb8d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:05.455441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea7716d6-3b26-42df-811f-83f5eafb8d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:05.455898 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea7716d6-3b26-42df-811f-83f5eafb8d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:05.456769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea7716d6-3b26-42df-811f-83f5eafb8d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:05.457213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ea7716d6-3b26-42df-811f-83f5eafb8d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:05.491177 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ea7716d6-3b26-42df-811f-83f5eafb8d35 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050129 Jul 29 04:55:05.492671 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 410/830] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:55:05 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:06.504954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a3b5a8f1-7045-4270-8467-b8d4972dc993 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:06.507108 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a3b5a8f1-7045-4270-8467-b8d4972dc993 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:06.513552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a3b5a8f1-7045-4270-8467-b8d4972dc993 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:06.514783 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a3b5a8f1-7045-4270-8467-b8d4972dc993 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:06.515620 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a3b5a8f1-7045-4270-8467-b8d4972dc993 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:06.516067 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a3b5a8f1-7045-4270-8467-b8d4972dc993 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:06.545386 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a3b5a8f1-7045-4270-8467-b8d4972dc993 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044391 Jul 29 04:55:06.545949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 421/831] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:55:06 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:55:06.620233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:06.620968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:06.627780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:06.628229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:06.629022 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:06.629456 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:06.656130 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:55:06.748647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9fcce751-e3bd-47a9-8470-2c0a75fb1abf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 204 len: 0 microversion: 2.1 time: 0.133718 Jul 29 04:55:06.750027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 411/832] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:55:06 2022] DELETE /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 04:55:06.758322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:06.759102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:06.766381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:06.766970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:06.767992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:06.768507 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:06.919544 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:06.927598 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-baf3aa7d-9bf8-4768-94f7-dca521ea1a4e tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1690 microversion: 2.1 time: 0.173214 Jul 29 04:55:06.928278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 422/833] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:06 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:07.949689 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:07.950310 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:07.957532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:07.957985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:07.958768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:07.959218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:08.425763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:08.433615 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1bd65454-fd11-4566-9707-a6bc3f72f90a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1690 microversion: 2.1 time: 0.488153 Jul 29 04:55:08.434279 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 412/834] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:07 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1690 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:09.455660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:09.457012 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:09.466174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:09.466931 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:09.467949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:09.468577 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:09.620494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:09.630453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-67e804ec-deba-49c9-badb-8803f9172aa8 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1690 microversion: 2.1 time: 0.179581 Jul 29 04:55:09.631038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 423/835] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:09 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:09.832548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-30a62696-df66-4742-99e5-a614d13eda6a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:09.834817 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-30a62696-df66-4742-99e5-a614d13eda6a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:09.841510 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30a62696-df66-4742-99e5-a614d13eda6a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:09.842115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30a62696-df66-4742-99e5-a614d13eda6a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:09.842895 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30a62696-df66-4742-99e5-a614d13eda6a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:09.843343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30a62696-df66-4742-99e5-a614d13eda6a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:09.872168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-30a62696-df66-4742-99e5-a614d13eda6a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043709 Jul 29 04:55:09.872761 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 413/836] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:55:09 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:55:09.939121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:09.939664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:09.946180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:09.946763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:09.947562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:09.948079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:10.142121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Going to try to terminate instance {{(pid=129684) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:55:10.228970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4535d103-84d3-4bb9-90be-5760b9031bba tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 204 len: 0 microversion: 2.1 time: 0.297060 Jul 29 04:55:10.229794 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 424/837] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:55:09 2022] DELETE /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:55:10.238875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:10.239701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:10.246146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:10.246596 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:10.247370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:10.247804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:10.395295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:10.402932 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-65863a09-c0d5-4205-beeb-924bc96a962b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1674 microversion: 2.1 time: 0.168006 Jul 29 04:55:10.403503 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 414/838] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:10 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:10.655634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:10.656380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:10.667374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:10.667836 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:10.668695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:10.669199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:10.921753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:10.929876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-50a796b5-9bdf-479b-b620-d47d28749368 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1690 microversion: 2.1 time: 0.279565 Jul 29 04:55:10.930502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 425/839] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:10 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1690 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:11.424244 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:11.424888 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:11.431638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:11.432099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:11.432991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:11.433432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:11.575487 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:11.584107 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-408e495a-3cb0-49fe-9eed-0f7528f7ba9b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1674 microversion: 2.1 time: 0.163813 Jul 29 04:55:11.584807 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 415/840] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:11 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:11.952251 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:11.953039 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:11.962259 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:11.962807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:11.963669 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:11.964183 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:12.562152 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:12.569636 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-01f8be99-b85b-49e3-b89d-e99763364045 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1690 microversion: 2.1 time: 0.621955 Jul 29 04:55:12.570201 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 426/841] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:11 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1690 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:12.606553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:12.607207 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:12.614055 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:12.614507 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:12.615281 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:12.615727 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:12.752727 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:12.760427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7daf034d-00b6-4acd-9c11-b95135433b06 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1674 microversion: 2.1 time: 0.157982 Jul 29 04:55:12.761015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 416/842] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:12 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:13.511492 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-9c42005b-ec24-49d3-a167-f4b32e62443a req-1efab2f0-8b1a-495d-832e-23abd3180f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f027c23f-8c17-419b-80a0-bdb62b416da3", "name": "network-vif-deleted", "tag": "aee6ef22-26d9-4a6a-b997-015edcbf797e"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:13.534690 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9c42005b-ec24-49d3-a167-f4b32e62443a req-1efab2f0-8b1a-495d-832e-23abd3180f01 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:13.535496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9c42005b-ec24-49d3-a167-f4b32e62443a req-1efab2f0-8b1a-495d-832e-23abd3180f01 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:13.560321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-9c42005b-ec24-49d3-a167-f4b32e62443a req-1efab2f0-8b1a-495d-832e-23abd3180f01 service nova] Creating event network-vif-deleted:aee6ef22-26d9-4a6a-b997-015edcbf797e for instance f027c23f-8c17-419b-80a0-bdb62b416da3 on hv-cinder-85144 Jul 29 04:55:13.580431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-9c42005b-ec24-49d3-a167-f4b32e62443a req-1efab2f0-8b1a-495d-832e-23abd3180f01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072556 Jul 29 04:55:13.581394 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 427/843] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:13.593262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:13.593976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:13.601353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:13.602021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:13.603025 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:13.603636 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:13.721110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:13.733492 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-38ff7c69-eef5-48be-843e-2623bc07afc4 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 200 len: 1331 microversion: 2.1 time: 0.144653 Jul 29 04:55:13.735441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 417/844] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:13 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 1331 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:13.784708 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:13.785657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:13.799363 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:13.800015 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:13.801009 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:13.801528 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:13.866004 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:13.866650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:13.867372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'fault' on Instance uuid 32c9906c-fdab-4215-a1c5-5cb82c3ab79e {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:55:13.918889 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:13.927180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-abe1c12c-9eaa-45bf-a3e8-7feba8a393d4 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 200 len: 1328 microversion: 2.1 time: 0.147117 Jul 29 04:55:13.927180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 428/845] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:13 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 1328 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:14.754674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:14.755308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: f027c23f-8c17-419b-80a0-bdb62b416da3] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:14.761927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:14.762374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:14.763135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:14.763651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:14.777118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] HTTP exception thrown: Instance f027c23f-8c17-419b-80a0-bdb62b416da3 could not be found. Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Request method failure captured: Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 HTTP/1.1 Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZhlNNaO7HnMZzvgbxie8U5RKqqwvq_Bq6GMJi5VZh7oiuxTWcZp_kC9HxflMzmzIMuMvOP9TRm4TMboTmNgulYrkVZgRQLQCFy247oo2-KsOMTwWtV0ThTLvBHwpFQbue4zcZdxDvH6Tsa_H2roUzECLDDqCk-Yda_F3VRh8ODwP8 Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:55:14.778897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 5f9d45265c6f47609f9f8abcf3526ff0 Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance f027c23f-8c17-419b-80a0-bdb62b416da3 could not be found. Jul 29 04:55:14.781096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': 'f027c23f-8c17-419b-80a0-bdb62b416da3'} Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f027c23f-8c17-419b-80a0-bdb62b416da3 could not be found. Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:55:14.781967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f027c23f-8c17-419b-80a0-bdb62b416da3 could not be found. Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f027c23f-8c17-419b-80a0-bdb62b416da3 could not be found. Jul 29 04:55:14.783453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.784872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Returning 404 to user: Instance f027c23f-8c17-419b-80a0-bdb62b416da3 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:55:14.784872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-69ffe9e2-c001-45e6-9076-4eebbb1c8b3f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3" status: 404 len: 111 microversion: 2.1 time: 0.030012 Jul 29 04:55:14.784872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 418/846] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:14 2022] GET /compute/v2.1/servers/f027c23f-8c17-419b-80a0-bdb62b416da3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:55:14.789876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4bfb5936-61d7-4abf-b340-ae11304cb364 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '.version_select at 0x7f3c541661f0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:14.809370 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4bfb5936-61d7-4abf-b340-ae11304cb364 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004759515" status: 202 len: 0 microversion: 2.1 time: 0.023363 Jul 29 04:55:14.809961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 429/847] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Jul 29 04:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004759515 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 04:55:14.948396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:14.949040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:14.956166 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:14.956707 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:14.957426 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:14.957876 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:14.975250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] HTTP exception thrown: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Request method failure captured: Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e HTTP/1.1 Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42Ziig0WPSjAVlfNVqxEyk0O0ZjyzCua6ZMMGTCb0AYobw6b9XATg-YQXsldKayQDamqssKZPjSSOW6USgKvn0JsfAV8zwGdgF7ghj1tsmpiiM6H6E_DjhPRGFTIE25uzpO6K6k0mT2w6Nq-T-QdvRhcFRKPRyj7uyoxjAkFdNvwAO0 Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:55:14.976919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 8b7751b93f88424abebe6859f46f8351 Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:55:14.978362 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '32c9906c-fdab-4215-a1c5-5cb82c3ab79e'} Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:55:14.979148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:55:14.980989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:14.983119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Returning 404 to user: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:55:14.983119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-87d6813f-f8e6-485e-af60-1a049a01917d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 404 len: 111 microversion: 2.1 time: 0.034151 Jul 29 04:55:14.983119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 419/848] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:14 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:55:14.988820 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d93cff79-140e-4f45-9e5c-947f16a7b75d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '.version_select at 0x7f3c54172ca0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:15.008018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d93cff79-140e-4f45-9e5c-947f16a7b75d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057391386" status: 202 len: 0 microversion: 2.1 time: 0.023786 Jul 29 04:55:15.008796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 430/849] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Jul 29 04:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057391386 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:55:15.600953 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-1eea9b71-2caf-4bb0-8927-70b00b0daa75 req-1a861bb7-7ae4-4fae-9aa5-ff26ac704fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c9906c-fdab-4215-a1c5-5cb82c3ab79e", "name": "network-vif-deleted", "tag": "df448b29-2557-4bee-808a-385ffcca1ff4"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:15.610760 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-1eea9b71-2caf-4bb0-8927-70b00b0daa75 req-1a861bb7-7ae4-4fae-9aa5-ff26ac704fe3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:15.611219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-1eea9b71-2caf-4bb0-8927-70b00b0daa75 req-1a861bb7-7ae4-4fae-9aa5-ff26ac704fe3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:15.622663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-1eea9b71-2caf-4bb0-8927-70b00b0daa75 req-1a861bb7-7ae4-4fae-9aa5-ff26ac704fe3 service nova] Creating event network-vif-deleted:df448b29-2557-4bee-808a-385ffcca1ff4 for instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e on hv-cinder-85144 Jul 29 04:55:15.627863 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-1eea9b71-2caf-4bb0-8927-70b00b0daa75 req-1a861bb7-7ae4-4fae-9aa5-ff26ac704fe3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030524 Jul 29 04:55:15.628621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 420/850] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:15.651865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8f661845-3ba5-46fa-a9ec-f60160bc53ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'create', calling method: .version_select at 0x7f3c5430bee0>, body: {"keypair": {"name": "tempest-keypair-468706397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBgnoimmdz6oq95mzRrCKaimSUxplmIxeUwaJDc/ThErpGxjiH42U9+DQ/5hCMl2je/n8GO9DthZsQmL30PRZhyXP+KoRjUs6ErY2nKspkZSq7WTh6N5p8Hs7We/DvDFQ=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:15.668477 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-8f661845-3ba5-46fa-a9ec-f60160bc53ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for project 946bf1e173f9476d86cf6133055fba0a. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:55:15.673357 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-8f661845-3ba5-46fa-a9ec-f60160bc53ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for user 8b7751b93f88424abebe6859f46f8351 and project 946bf1e173f9476d86cf6133055fba0a. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:55:15.694125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8f661845-3ba5-46fa-a9ec-f60160bc53ca tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046173 Jul 29 04:55:15.694708 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 431/851] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:55:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:17.008748 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-332442547", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bcca997-0807-424d-86d3-43681c4961dd"}], "security_groups": [{"name": "tempest-securitygroup--506545389"}], "key_name": "tempest-keypair-468706397", "user_data": "}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:17.111715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] validate_networks() for [('4bcca997-0807-424d-86d3-43681c4961dd', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:55:17.473738 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:55:17.474162 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:55:17.474633 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:55:17.475040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:55:17.475449 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:55:17.484942 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:17.485386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:17.486176 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:17.486616 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:17.503348 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for project 946bf1e173f9476d86cf6133055fba0a. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:55:17.507258 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Getting quotas for user 8b7751b93f88424abebe6859f46f8351 and project 946bf1e173f9476d86cf6133055fba0a. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:55:17.517987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:55:17.520264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:55:17.566013 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [80db74e8-ab8e-4e5d-8533-4c9347b1ec15] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 04:55:17.727784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:17.728294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:17.734912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:17.735371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:17.736140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:17.736583 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:17.762710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Going to try to terminate instance {{(pid=129684) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:55:17.834637 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-440dbbcb-c731-4d44-abc4-85f13477db6a tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 204 len: 0 microversion: 2.1 time: 0.110834 Jul 29 04:55:17.835237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 432/852] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:55:17 2022] DELETE /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 04:55:17.844464 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:17.845187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:17.851308 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:17.851763 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:17.852539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:17.853022 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:17.984543 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:17.991997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5ca9555d-b6ed-4f7a-8794-4fae91927b59 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1508 microversion: 2.1 time: 0.152245 Jul 29 04:55:17.992571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 433/853] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:17 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:55:18.573350 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [80db74e8-ab8e-4e5d-8533-4c9347b1ec15] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 49026. Jul 29 04:55:18.578265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2e0f3912-04b4-4de0-ac49-eb4f967cd2c5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.574768 Jul 29 04:55:18.578985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 421/854] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:55:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:55:18.590539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e6b53a01-dd24-40de-8642-ed907a0be56e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:18.591322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e6b53a01-dd24-40de-8642-ed907a0be56e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:18.655706 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e6b53a01-dd24-40de-8642-ed907a0be56e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:18.662042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e6b53a01-dd24-40de-8642-ed907a0be56e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1236 microversion: 2.1 time: 0.075824 Jul 29 04:55:18.669188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 434/855] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:18 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:19.014076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:19.014689 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:19.021902 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:19.022354 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:19.023125 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:19.023561 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:19.090506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:19.102907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-eab95da4-9666-4583-9736-a2ad432be9fe tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 200 len: 1466 microversion: 2.1 time: 0.093290 Jul 29 04:55:19.111350 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 422/856] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:19 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 1466 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:19.175145 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-a75a2df3-099b-415a-a974-bee88a6fac20 req-e650dcad-4198-45d7-95ad-7bda1989cd00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3508a994-61f6-4db5-83be-063a6eedc0cd", "name": "network-vif-deleted", "tag": "70e45860-f254-40d2-808c-c68bdc1a745b"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:19.186248 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-a75a2df3-099b-415a-a974-bee88a6fac20 req-e650dcad-4198-45d7-95ad-7bda1989cd00 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:19.186612 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-a75a2df3-099b-415a-a974-bee88a6fac20 req-e650dcad-4198-45d7-95ad-7bda1989cd00 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:19.198489 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-a75a2df3-099b-415a-a974-bee88a6fac20 req-e650dcad-4198-45d7-95ad-7bda1989cd00 service nova] Creating event network-vif-deleted:70e45860-f254-40d2-808c-c68bdc1a745b for instance 3508a994-61f6-4db5-83be-063a6eedc0cd on hv-cinder-85144 Jul 29 04:55:19.203519 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-a75a2df3-099b-415a-a974-bee88a6fac20 req-e650dcad-4198-45d7-95ad-7bda1989cd00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032048 Jul 29 04:55:19.204459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 435/857] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:19.683282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:19.683903 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:19.690242 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:19.690699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:19.691469 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:19.691915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:19.753396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:19.760916 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d94395dc-296b-41c0-a39d-9a2a45739b18 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1296 microversion: 2.1 time: 0.081494 Jul 29 04:55:19.761478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 423/858] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:19 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:20.124563 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:20.125293 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 3508a994-61f6-4db5-83be-063a6eedc0cd] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:20.132848 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.133681 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.135113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.135918 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.153288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] HTTP exception thrown: Instance 3508a994-61f6-4db5-83be-063a6eedc0cd could not be found. Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Request method failure captured: Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd HTTP/1.1 Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZhlNNaO7HnMZzvgbxie8U5RKqqwvq_Bq6GMJi5VZh7oiuxTWcZp_kC9HxflMzmzIMuMvOP9TRm4TMboTmNgulYrkVZgRQLQCFy247oo2-KsOMTwWtV0ThTLvBHwpFQbue4zcZdxDvH6Tsa_H2roUzECLDDqCk-Yda_F3VRh8ODwP8 Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:55:20.154958 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 5f9d45265c6f47609f9f8abcf3526ff0 Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 3508a994-61f6-4db5-83be-063a6eedc0cd could not be found. Jul 29 04:55:20.156512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '3508a994-61f6-4db5-83be-063a6eedc0cd'} Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3508a994-61f6-4db5-83be-063a6eedc0cd could not be found. Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:55:20.157417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3508a994-61f6-4db5-83be-063a6eedc0cd could not be found. Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3508a994-61f6-4db5-83be-063a6eedc0cd could not be found. Jul 29 04:55:20.158605 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:55:20.159639 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Returning 404 to user: Instance 3508a994-61f6-4db5-83be-063a6eedc0cd could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:55:20.159639 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b37ad94e-1735-437c-8444-2a8a94d3c64f tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd" status: 404 len: 111 microversion: 2.1 time: 0.036774 Jul 29 04:55:20.159639 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 436/859] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:20 2022] GET /compute/v2.1/servers/3508a994-61f6-4db5-83be-063a6eedc0cd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:55:20.165441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:20.165941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:20.173793 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.174254 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.175023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.175466 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.202023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:55:20.216171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:20.281794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-892fd262-db4b-4f5d-961f-4129686060b2 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "DELETE /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 204 len: 0 microversion: 2.1 time: 0.120406 Jul 29 04:55:20.282502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 424/860] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:55:20 2022] DELETE /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 04:55:20.293049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:20.294322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:20.302321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.302784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.303562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.304002 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.308140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:20.508953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:20.517279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c5e6b421-f52f-4819-9cc5-eeea86833443 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.229217 Jul 29 04:55:20.517854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 437/861] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:20 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:20.782455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:20.783093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:20.789770 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.790562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.791779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:20.792425 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:20.934847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:20.943668 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a55c58dc-88b9-44b4-ad80-68425373b8e3 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.165507 Jul 29 04:55:20.944244 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 425/862] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:20 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:21.538217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:21.538841 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:21.545579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:21.546036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:21.546817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:21.547253 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:21.676393 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:21.683822 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-02c22fcf-f903-436f-82a4-bf2e5933642d tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.149605 Jul 29 04:55:21.684381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 438/863] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:21 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:21.965514 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:21.966144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:21.973237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:21.973699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:21.974508 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:21.974945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:22.107641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:22.115481 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-59ff4c45-7e20-4fe5-b486-cb62459c4bea tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.153836 Jul 29 04:55:22.116450 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 426/864] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:21 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:22.706785 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:22.707588 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:22.714730 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:22.715181 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:22.716151 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:22.717750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:22.758417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-87f454c1-d18d-479f-ac38-aa279d12c525 req-52c1bd7c-cdca-47d8-86d4-825d60703452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f419f4-d879-49b1-b580-9bfbd7a1f5a8", "tag": "2548b355-cc75-4f48-aa15-872f7943167a"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:22.774951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-87f454c1-d18d-479f-ac38-aa279d12c525 req-52c1bd7c-cdca-47d8-86d4-825d60703452 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:22.775400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-87f454c1-d18d-479f-ac38-aa279d12c525 req-52c1bd7c-cdca-47d8-86d4-825d60703452 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:22.789579 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-87f454c1-d18d-479f-ac38-aa279d12c525 req-52c1bd7c-cdca-47d8-86d4-825d60703452 service nova] Creating event network-changed:2548b355-cc75-4f48-aa15-872f7943167a for instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 on hv-cinder-85144 Jul 29 04:55:22.796392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-87f454c1-d18d-479f-ac38-aa279d12c525 req-52c1bd7c-cdca-47d8-86d4-825d60703452 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043148 Jul 29 04:55:22.797716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 427/865] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:23.141071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:23.141780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:23.148353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:23.148870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:23.149933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:23.150406 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:23.293000 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:23.301571 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bc7a2848-30c9-4ecc-af61-63b4b374a564 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.165791 Jul 29 04:55:23.302147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 428/866] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:23 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:23.333196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:23.340887 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9c70784b-f030-460b-8032-bef076bd17bf tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1520 microversion: 2.1 time: 0.638027 Jul 29 04:55:23.342516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 439/867] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:22 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1520 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:55:24.322569 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:24.323185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:24.331557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:24.331964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:24.332776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:24.333223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:24.362934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:24.363769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:24.371522 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:24.371978 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:24.373291 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:24.373726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:24.408405 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:24.408866 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:24.409329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lazy-loading 'fault' on Instance uuid 052579df-c255-4129-911a-8a4dda7e6ced {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:55:24.450445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:24.458409 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6d0e8f85-e0c9-425a-8dd0-c75514bc6436 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1311 microversion: 2.1 time: 0.099341 Jul 29 04:55:24.458975 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 440/868] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:24 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:24.467799 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:24.475447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-775d1032-feb6-4ff4-b8b3-dcce50da0c68 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.156758 Jul 29 04:55:24.476021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 429/869] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:24 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:25.057461 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-501acf6c-dde8-4882-8d7f-6d3cc6b599bd req-8d1fc46e-64be-443b-a997-7136da2e5a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052579df-c255-4129-911a-8a4dda7e6ced", "name": "network-vif-deleted", "tag": "aec72477-e53c-4111-8650-f834671263de"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:25.067355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-501acf6c-dde8-4882-8d7f-6d3cc6b599bd req-8d1fc46e-64be-443b-a997-7136da2e5a95 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:25.067805 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-501acf6c-dde8-4882-8d7f-6d3cc6b599bd req-8d1fc46e-64be-443b-a997-7136da2e5a95 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:25.078721 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-501acf6c-dde8-4882-8d7f-6d3cc6b599bd req-8d1fc46e-64be-443b-a997-7136da2e5a95 service nova] Creating event network-vif-deleted:aec72477-e53c-4111-8650-f834671263de for instance 052579df-c255-4129-911a-8a4dda7e6ced on hv-cinder-85144 Jul 29 04:55:25.083445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-501acf6c-dde8-4882-8d7f-6d3cc6b599bd req-8d1fc46e-64be-443b-a997-7136da2e5a95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029691 Jul 29 04:55:25.084014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 441/870] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:25.479570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:25.480100 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:25.486761 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:25.487219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:25.487997 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:25.488442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:25.496095 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:25.496828 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:25.503024 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:25.503481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:25.504270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:25.504739 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:25.519621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:25.520079 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:25.520534 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lazy-loading 'fault' on Instance uuid 052579df-c255-4129-911a-8a4dda7e6ced {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:55:25.561358 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:25.569247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-23a8bec5-45a6-43f3-b6d0-c93990e62769 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1311 microversion: 2.1 time: 0.093576 Jul 29 04:55:25.569925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 430/871] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:25 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:25.640576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:25.647970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b08a0c68-a80f-4774-8b59-e0ebc5362061 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.156518 Jul 29 04:55:25.648543 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 442/872] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:25 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:55:26.590815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:26.591463 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:26.599001 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:26.599736 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:26.600529 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:26.601004 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:26.638068 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:26.638730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:26.640049 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lazy-loading 'fault' on Instance uuid 052579df-c255-4129-911a-8a4dda7e6ced {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:55:26.669428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:26.670034 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:26.685975 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:26.687077 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:26.687856 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:26.710465 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:26.714277 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f9d45265c6f47609f9f8abcf3526ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6c1ad3422c40d4af4ef5329ecd9d86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:26.724055 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1d0e265c-f068-497a-8c6c-dd33aace76bb tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 200 len: 1311 microversion: 2.1 time: 0.137071 Jul 29 04:55:26.725532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 431/873] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:26 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:26.932279 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:26.941644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d56bd336-529f-450f-970e-5126238ab9f5 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.275898 Jul 29 04:55:26.942209 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 443/874] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:26 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:27.746041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:27.746664 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] [instance: 052579df-c255-4129-911a-8a4dda7e6ced] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:27.749323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:27.750080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:27.756431 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:27.756915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:27.757688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:27.758164 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:27.771274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] HTTP exception thrown: Instance 052579df-c255-4129-911a-8a4dda7e6ced could not be found. Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Request method failure captured: Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced HTTP/1.1 Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZhlNNaO7HnMZzvgbxie8U5RKqqwvq_Bq6GMJi5VZh7oiuxTWcZp_kC9HxflMzmzIMuMvOP9TRm4TMboTmNgulYrkVZgRQLQCFy247oo2-KsOMTwWtV0ThTLvBHwpFQbue4zcZdxDvH6Tsa_H2roUzECLDDqCk-Yda_F3VRh8ODwP8 Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:55:27.772929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0f6c1ad3422c40d4af4ef5329ecd9d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 0f6c1ad3422c40d4af4ef5329ecd9d86 Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1807632209 Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 5f9d45265c6f47609f9f8abcf3526ff0 Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1807632209-project Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 052579df-c255-4129-911a-8a4dda7e6ced could not be found. Jul 29 04:55:27.774474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '052579df-c255-4129-911a-8a4dda7e6ced'} Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052579df-c255-4129-911a-8a4dda7e6ced could not be found. Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:55:27.775355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052579df-c255-4129-911a-8a4dda7e6ced could not be found. Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052579df-c255-4129-911a-8a4dda7e6ced could not be found. Jul 29 04:55:27.776924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:27.778196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] Returning 404 to user: Instance 052579df-c255-4129-911a-8a4dda7e6ced could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:55:27.778196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-db71ef02-040e-47ce-a57b-47f040cc87e0 tempest-ServerRescueNegativeTestJSON-1807632209 tempest-ServerRescueNegativeTestJSON-1807632209-project] 10.222.0.40 "GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced" status: 404 len: 111 microversion: 2.1 time: 0.032386 Jul 29 04:55:27.778196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 432/875] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:27 2022] GET /compute/v2.1/servers/052579df-c255-4129-911a-8a4dda7e6ced => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:55:27.964288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:27.965691 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:27.975075 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:27.975939 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:27.996708 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:27.997625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:28.077827 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-b85aca78-0a8b-4e3d-9e0f-23a782ce32fa req-5870c6c2-ad51-4a4d-976e-6ca3c049fe45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f419f4-d879-49b1-b580-9bfbd7a1f5a8", "name": "network-vif-plugged", "status": "completed", "tag": "2548b355-cc75-4f48-aa15-872f7943167a"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:28.099004 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-b85aca78-0a8b-4e3d-9e0f-23a782ce32fa req-5870c6c2-ad51-4a4d-976e-6ca3c049fe45 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:28.099457 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-b85aca78-0a8b-4e3d-9e0f-23a782ce32fa req-5870c6c2-ad51-4a4d-976e-6ca3c049fe45 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:28.112906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-b85aca78-0a8b-4e3d-9e0f-23a782ce32fa req-5870c6c2-ad51-4a4d-976e-6ca3c049fe45 service nova] Creating event network-vif-plugged:2548b355-cc75-4f48-aa15-872f7943167a for instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 on hv-cinder-85144 Jul 29 04:55:28.117720 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-b85aca78-0a8b-4e3d-9e0f-23a782ce32fa req-5870c6c2-ad51-4a4d-976e-6ca3c049fe45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044269 Jul 29 04:55:28.118479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 433/876] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:55:28.265359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:28.274085 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-973569eb-e236-43d8-928e-c3f005d03d00 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.315247 Jul 29 04:55:28.274998 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 444/877] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:27 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:29.297266 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:29.297992 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:29.304404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:29.304875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:29.305667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:29.306113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:29.446990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:29.455263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-dffbb5a0-c737-4ef0-9908-8f11cc44cb02 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1361 microversion: 2.1 time: 0.163240 Jul 29 04:55:29.455854 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 434/878] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:29 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:55:30.476153 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:30.477814 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:30.481074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:30.486799 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:30.487353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:30.488414 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:30.488947 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:30.650991 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:55:30.658688 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f9fcc56b-b6b5-45d2-9888-e10309cc75dd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1547 microversion: 2.1 time: 0.187153 Jul 29 04:55:30.659494 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 445/879] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:55:30 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:30.680418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e62957a9-1be5-4fb0-a4ca-a65ae12e439f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:30.680939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e62957a9-1be5-4fb0-a4ca-a65ae12e439f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:30.688172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e62957a9-1be5-4fb0-a4ca-a65ae12e439f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:30.688660 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e62957a9-1be5-4fb0-a4ca-a65ae12e439f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:30.689434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e62957a9-1be5-4fb0-a4ca-a65ae12e439f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:30.689876 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e62957a9-1be5-4fb0-a4ca-a65ae12e439f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:30.794833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e62957a9-1be5-4fb0-a4ca-a65ae12e439f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118337 Jul 29 04:55:30.796093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 435/880] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:55:30 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:32.470593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-cb327303-d2f8-48ed-9422-5dc6a921f6a4 req-17b49645-dbe4-4304-93df-1bd7e8910292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f419f4-d879-49b1-b580-9bfbd7a1f5a8", "tag": "2548b355-cc75-4f48-aa15-872f7943167a"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:32.485935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-cb327303-d2f8-48ed-9422-5dc6a921f6a4 req-17b49645-dbe4-4304-93df-1bd7e8910292 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:32.486666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-cb327303-d2f8-48ed-9422-5dc6a921f6a4 req-17b49645-dbe4-4304-93df-1bd7e8910292 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:32.500979 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-cb327303-d2f8-48ed-9422-5dc6a921f6a4 req-17b49645-dbe4-4304-93df-1bd7e8910292 service nova] Creating event network-changed:2548b355-cc75-4f48-aa15-872f7943167a for instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 on hv-cinder-85144 Jul 29 04:55:32.507259 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-cb327303-d2f8-48ed-9422-5dc6a921f6a4 req-17b49645-dbe4-4304-93df-1bd7e8910292 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042805 Jul 29 04:55:32.508791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 446/881] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:33.758475 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-083896ac-8884-4726-8e15-9be2db1bc769 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Action: 'create', calling method: .version_select at 0x7f3c58b533a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1782881702", "metadata": {"Type": "work"}}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:34.044318 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-083896ac-8884-4726-8e15-9be2db1bc769 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.441421 Jul 29 04:55:34.045006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 436/882] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Jul 29 04:55:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 443 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 04:55:34.058470 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4f2c1f31-a625-4cdf-822f-5280f1ba7116 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Calling method '.version_select at 0x7f3c54166dc0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:34.111623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4f2c1f31-a625-4cdf-822f-5280f1ba7116 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e" status: 200 len: 353 microversion: 2.1 time: 0.057791 Jul 29 04:55:34.112196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 447/883] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:34 2022] GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:35.126184 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4a7f5ff2-b09c-4ce5-918e-fbd9b3b1d0c2 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Calling method '.version_select at 0x7f3c58a9b040>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:35.179359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4a7f5ff2-b09c-4ce5-918e-fbd9b3b1d0c2 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e" status: 200 len: 354 microversion: 2.1 time: 0.057430 Jul 29 04:55:35.179956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 437/884] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:35 2022] GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:35.192766 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e81cce08-d877-4f88-bd18-6039e6960857 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Calling method '.version_select at 0x7f3c5431f3a0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:35.238217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e81cce08-d877-4f88-bd18-6039e6960857 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e" status: 200 len: 354 microversion: 2.1 time: 0.049786 Jul 29 04:55:35.238796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 448/885] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:35 2022] GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:35.251156 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0830677c-feb8-4503-9ce2-d1f4672bf32f tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Calling method '.version_select at 0x7f3c543691f0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:35.312364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0830677c-feb8-4503-9ce2-d1f4672bf32f tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e" status: 202 len: 0 microversion: 2.1 time: 0.064919 Jul 29 04:55:35.312965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 438/886] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:55:35 2022] DELETE /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:55:35.320856 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-17592f73-5348-401d-a1e4-4ab2478647d1 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Calling method '.version_select at 0x7f3c5431f310>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:35.368113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-17592f73-5348-401d-a1e4-4ab2478647d1 tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e" status: 200 len: 353 microversion: 2.1 time: 0.051006 Jul 29 04:55:35.368712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 449/887] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:35 2022] GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:36.382606 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bc1a0e74-137d-41c4-a7dd-a26b7ba9e87c tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Calling method '.version_select at 0x7f3c58a9b1f0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:36.410424 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-bc1a0e74-137d-41c4-a7dd-a26b7ba9e87c tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] HTTP exception thrown: Volume 70b1b5d1-683f-42a8-847c-35118fa3bb3e could not be found. Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bc1a0e74-137d-41c4-a7dd-a26b7ba9e87c tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Request method failure captured: Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e HTTP/1.1 Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42hF7DSadOVPuY2riKHKrjL3yIEXy5sW-O-CVF-dQgnKbzFIMHUBr-b9HUcmwcXtuyJVpLJMywXbQRLH-A_TeBKOPcRFSo40FwDwY2b2El1XTFvdRUWscHOBAhPRV8nbhRRUH5XFL95AOdNAbTF2bCsy5hCi_8_39wQiWuh3z4YVi-o Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: acfceb52b610450a9b60e74a1932d9e4 Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-VolumesGetTestJSON-3492213 Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:55:36.412803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_acfceb52b610450a9b60e74a1932d9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfceb52b610450a9b60e74a1932d9e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/acfceb52b610450a9b60e74a1932d9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/acfceb52b610450a9b60e74a1932d9e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-VolumesGetTestJSON-3492213 Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: acfceb52b610450a9b60e74a1932d9e4 Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-VolumesGetTestJSON-3492213 Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-VolumesGetTestJSON-3492213-project Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: c02475bd1f49459a925b1550c7f25dda Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-VolumesGetTestJSON-3492213-project Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Volume 70b1b5d1-683f-42a8-847c-35118fa3bb3e could not be found. Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '70b1b5d1-683f-42a8-847c-35118fa3bb3e'} Jul 29 04:55:36.414688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70b1b5d1-683f-42a8-847c-35118fa3bb3e could not be found. (HTTP 404) (Request-ID: req-b4f0cad7-e29d-460e-a2c1-4abab180b6d4) Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:36.417548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 04:55:36.418914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70b1b5d1-683f-42a8-847c-35118fa3bb3e could not be found. Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 04:55:36.420959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70b1b5d1-683f-42a8-847c-35118fa3bb3e could not be found. Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70b1b5d1-683f-42a8-847c-35118fa3bb3e could not be found. Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bc1a0e74-137d-41c4-a7dd-a26b7ba9e87c tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] Returning 404 to user: Volume 70b1b5d1-683f-42a8-847c-35118fa3bb3e could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bc1a0e74-137d-41c4-a7dd-a26b7ba9e87c tempest-VolumesGetTestJSON-3492213 tempest-VolumesGetTestJSON-3492213-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e" status: 404 len: 109 microversion: 2.1 time: 0.036000 Jul 29 04:55:36.422819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 439/888] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:36 2022] GET /compute/v2.1/os-volumes/70b1b5d1-683f-42a8-847c-35118fa3bb3e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:55:39.141980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-13291552-195f-40d2-93d5-a01036298d73 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c540cdaf0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:39.189495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-13291552-195f-40d2-93d5-a01036298d73 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6e7c81c7-cf8f-4a58-b187-9c247fb67345" status: 200 len: 351 microversion: 2.1 time: 0.052490 Jul 29 04:55:39.190069 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 450/889] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:39 2022] GET /compute/v2.1/os-volumes/6e7c81c7-cf8f-4a58-b187-9c247fb67345 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:40.519777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-411f05a0-1885-41ea-80d1-dc83b7909787 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c58b21ca0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:40.566163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-411f05a0-1885-41ea-80d1-dc83b7909787 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/b67d3740-3d4c-40e3-ab46-d5a0c8b689f5" status: 200 len: 350 microversion: 2.1 time: 0.050764 Jul 29 04:55:40.566729 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 440/890] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:40 2022] GET /compute/v2.1/os-volumes/b67d3740-3d4c-40e3-ab46-d5a0c8b689f5 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:41.891803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c8fc8871-8dd1-49ab-aebc-0c9c728f1887 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c54166c10>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:41.940026 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c8fc8871-8dd1-49ab-aebc-0c9c728f1887 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/807aca6b-0c65-4af7-88ed-cd46f476e129" status: 200 len: 351 microversion: 2.1 time: 0.053112 Jul 29 04:55:41.940627 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 451/891] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 04:55:41 2022] GET /compute/v2.1/os-volumes/807aca6b-0c65-4af7-88ed-cd46f476e129 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:41.950093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:41.950848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:41.955640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-66c36d28-efca-4dc7-8b52-983c68e7114d tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c543da790>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.040101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-66c36d28-efca-4dc7-8b52-983c68e7114d tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090662 Jul 29 04:55:42.040700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 441/892] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Jul 29 04:55:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:42.054325 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-54ab6343-e2b5-4fdf-9cb5-f5ada30dd978 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c54153dc0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.139851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-54ab6343-e2b5-4fdf-9cb5-f5ada30dd978 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089213 Jul 29 04:55:42.140413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 452/893] 10.222.0.40 () {58 vars in 1149 bytes} [Fri Jul 29 04:55:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:42.153434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-55a84e3b-7a14-4f35-8696-0d61c0ffce55 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c545bd550>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.238270 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-55a84e3b-7a14-4f35-8696-0d61c0ffce55 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088480 Jul 29 04:55:42.238840 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 442/894] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Jul 29 04:55:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:42.252267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-31c05f91-1394-4155-887d-73efe5a1d62b tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c544cf790>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.339567 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-31c05f91-1394-4155-887d-73efe5a1d62b tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091785 Jul 29 04:55:42.340161 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 453/895] 10.222.0.40 () {58 vars in 1167 bytes} [Fri Jul 29 04:55:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:42.353409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3b237519-e1dc-47fc-a956-68ddf9087e2c tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c58b5f280>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.435005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3b237519-e1dc-47fc-a956-68ddf9087e2c tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085295 Jul 29 04:55:42.436202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 443/896] 10.222.0.40 () {58 vars in 1170 bytes} [Fri Jul 29 04:55:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:42.449283 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1c8f1dd4-bf7e-4fca-af08-c3f1638e4a42 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c5431f5e0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.485105 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:42.498840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=52 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:55:42.532872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1c8f1dd4-bf7e-4fca-af08-c3f1638e4a42 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087247 Jul 29 04:55:42.533470 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 454/897] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Jul 29 04:55:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:42.546703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b5310124-ffa4-41cd-9df2-059336fca2e8 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c58b97f70>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.629333 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b5310124-ffa4-41cd-9df2-059336fca2e8 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086467 Jul 29 04:55:42.629899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 444/898] 10.222.0.40 () {58 vars in 1188 bytes} [Fri Jul 29 04:55:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:42.643272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cf3fb6da-46dd-4bcc-9cdf-d50d9bfd9fb0 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] Calling method '.version_select at 0x7f3c54265af0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:42.727654 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cf3fb6da-46dd-4bcc-9cdf-d50d9bfd9fb0 tempest-VolumesTestJSON-1317442580 tempest-VolumesTestJSON-1317442580-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088600 Jul 29 04:55:42.728222 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 455/899] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Jul 29 04:55:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:55:49.070440 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-17d2f523-6cea-4581-ae58-aca18f556555 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:55:49.071008 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-17d2f523-6cea-4581-ae58-aca18f556555 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:49.077604 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d2f523-6cea-4581-ae58-aca18f556555 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:49.078069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d2f523-6cea-4581-ae58-aca18f556555 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:49.078847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d2f523-6cea-4581-ae58-aca18f556555 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:49.079290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d2f523-6cea-4581-ae58-aca18f556555 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:49.102027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-17d2f523-6cea-4581-ae58-aca18f556555 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/ips" status: 200 len: 148 microversion: 2.1 time: 0.035980 Jul 29 04:55:49.102597 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 445/900] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:55:49 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:55:50.436003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9e19c819-ce60-4e16-9239-1e843fcb4bda tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03107312-af58-4a11-baab-b1e08247082b"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:55:50.438461 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9e19c819-ce60-4e16-9239-1e843fcb4bda tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:55:50.444744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e19c819-ce60-4e16-9239-1e843fcb4bda tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:50.445192 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e19c819-ce60-4e16-9239-1e843fcb4bda tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:50.445961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e19c819-ce60-4e16-9239-1e843fcb4bda tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:55:50.446396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9e19c819-ce60-4e16-9239-1e843fcb4bda tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:55:50.705155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9e19c819-ce60-4e16-9239-1e843fcb4bda tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274208 Jul 29 04:55:50.705771 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 456/901] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:55:50 2022] POST /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:02.540995 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03107312-af58-4a11-baab-b1e08247082b"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:02.543386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:02.545649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:02.546432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=4 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:02.551966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:02.552428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:02.553231 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:02.553679 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:02.630228 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Invalid volume: volume 03107312-af58-4a11-baab-b1e08247082b is already attached to instances: 88854861-a8db-44a2-839b-5e158363e71c Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: POST /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments HTTP/1.1 Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 74 Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:56:02.631833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {"volumeAttachment": {"volumeId": "03107312-af58-4a11-baab-b1e08247082b"}} Jul 29 04:56:02.633472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Invalid volume: volume 03107312-af58-4a11-baab-b1e08247082b is already attached to instances: 88854861-a8db-44a2-839b-5e158363e71c Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'server_id': '88854861-a8db-44a2-839b-5e158363e71c', 'body': {'volumeAttachment': {'volumeId': '03107312-af58-4a11-baab-b1e08247082b'}}} Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03107312-af58-4a11-baab-b1e08247082b is already attached to instances: 88854861-a8db-44a2-839b-5e158363e71c Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:56:02.634309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03107312-af58-4a11-baab-b1e08247082b is already attached to instances: 88854861-a8db-44a2-839b-5e158363e71c Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:56:02.635511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03107312-af58-4a11-baab-b1e08247082b is already attached to instances: 88854861-a8db-44a2-839b-5e158363e71c Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 400 to user: Invalid volume: volume 03107312-af58-4a11-baab-b1e08247082b is already attached to instances: 88854861-a8db-44a2-839b-5e158363e71c {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-faf73cde-a044-4277-b88b-13ffaec8f837 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096743 Jul 29 04:56:02.636999 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 446/902] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:56:02 2022] POST /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 04:56:02.696802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:02.697565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:02.702986 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:02.703585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:02.711094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:02.711548 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:02.712318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:02.712786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:02.793383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lazy-loading 'services' on Instance uuid 88854861-a8db-44a2-839b-5e158363e71c {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:56:02.862789 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2517c0d2-f461-42eb-ac41-fff305b9952c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments/03107312-af58-4a11-baab-b1e08247082b" status: 202 len: 0 microversion: 2.1 time: 0.167287 Jul 29 04:56:02.863369 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 457/903] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:56:02 2022] DELETE /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments/03107312-af58-4a11-baab-b1e08247082b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:56:02.872427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2e9dfd7d-0bc9-4200-8359-4fbd9d30b271 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:02.875564 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2e9dfd7d-0bc9-4200-8359-4fbd9d30b271 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:02.883556 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e9dfd7d-0bc9-4200-8359-4fbd9d30b271 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:02.884181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e9dfd7d-0bc9-4200-8359-4fbd9d30b271 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:02.885542 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e9dfd7d-0bc9-4200-8359-4fbd9d30b271 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:02.885994 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2e9dfd7d-0bc9-4200-8359-4fbd9d30b271 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:02.914669 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2e9dfd7d-0bc9-4200-8359-4fbd9d30b271 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Jul 29 04:56:02.915225 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 447/904] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:56:02 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:03.928098 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e8e5d1e8-cd8c-4dd8-ae88-5e4db3f1e5d1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:03.930381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e8e5d1e8-cd8c-4dd8-ae88-5e4db3f1e5d1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:03.936653 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8e5d1e8-cd8c-4dd8-ae88-5e4db3f1e5d1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:03.937099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8e5d1e8-cd8c-4dd8-ae88-5e4db3f1e5d1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:03.937854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8e5d1e8-cd8c-4dd8-ae88-5e4db3f1e5d1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:03.938291 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8e5d1e8-cd8c-4dd8-ae88-5e4db3f1e5d1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:03.967546 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e8e5d1e8-cd8c-4dd8-ae88-5e4db3f1e5d1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Jul 29 04:56:03.968087 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 458/905] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:56:03 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:04.979607 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-51b8a5f2-2928-4235-a95f-1ccc58072773 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:04.981695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-51b8a5f2-2928-4235-a95f-1ccc58072773 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:04.988884 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-51b8a5f2-2928-4235-a95f-1ccc58072773 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:04.989343 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-51b8a5f2-2928-4235-a95f-1ccc58072773 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:04.990120 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-51b8a5f2-2928-4235-a95f-1ccc58072773 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:04.990567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-51b8a5f2-2928-4235-a95f-1ccc58072773 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:05.020570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-51b8a5f2-2928-4235-a95f-1ccc58072773 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Jul 29 04:56:05.021170 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 448/906] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:56:04 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:06.033218 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6acfe5d0-2f43-482a-a109-b07cfd8f6c76 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:06.035433 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6acfe5d0-2f43-482a-a109-b07cfd8f6c76 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:06.042158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6acfe5d0-2f43-482a-a109-b07cfd8f6c76 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:06.042589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6acfe5d0-2f43-482a-a109-b07cfd8f6c76 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:06.043344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6acfe5d0-2f43-482a-a109-b07cfd8f6c76 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:06.043778 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6acfe5d0-2f43-482a-a109-b07cfd8f6c76 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:06.072595 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6acfe5d0-2f43-482a-a109-b07cfd8f6c76 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043530 Jul 29 04:56:06.073191 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 459/907] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:56:06 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:07.084874 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-54fa96dc-f0f9-40e7-8e68-9f2ed99c7bb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:07.086985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-54fa96dc-f0f9-40e7-8e68-9f2ed99c7bb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:07.093491 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54fa96dc-f0f9-40e7-8e68-9f2ed99c7bb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:07.093946 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54fa96dc-f0f9-40e7-8e68-9f2ed99c7bb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:07.094703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54fa96dc-f0f9-40e7-8e68-9f2ed99c7bb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:07.095136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-54fa96dc-f0f9-40e7-8e68-9f2ed99c7bb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:07.124958 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-54fa96dc-f0f9-40e7-8e68-9f2ed99c7bb7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Jul 29 04:56:07.125502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 449/908] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:56:07 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:08.136660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3e5b311f-6eca-4b21-8f48-cc82c2322a00 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:08.139396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3e5b311f-6eca-4b21-8f48-cc82c2322a00 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:08.146453 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5b311f-6eca-4b21-8f48-cc82c2322a00 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:08.147125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5b311f-6eca-4b21-8f48-cc82c2322a00 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:08.148094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5b311f-6eca-4b21-8f48-cc82c2322a00 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:08.148557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5b311f-6eca-4b21-8f48-cc82c2322a00 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:08.178712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3e5b311f-6eca-4b21-8f48-cc82c2322a00 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045933 Jul 29 04:56:08.179568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 460/909] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:56:08 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:56:08.243109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:08.243663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:08.250329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:08.250779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:08.251604 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:08.252034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:08.278855 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:56:08.351795 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-417ad407-4106-4756-972b-13ced84ee6a7 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 204 len: 0 microversion: 2.1 time: 0.112427 Jul 29 04:56:08.352436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 450/910] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:56:08 2022] DELETE /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:56:08.361444 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:08.362053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:08.369027 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:08.369475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:08.370233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:08.370665 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:08.509673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:08.518297 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4c0a9dfe-770c-4209-9bdd-d13b93e23bd1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1679 microversion: 2.1 time: 0.161461 Jul 29 04:56:08.518856 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 461/911] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:08 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:09.540176 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:09.540836 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:09.547452 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:09.547909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:09.548703 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:09.549151 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:09.681848 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:09.690204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e63bd9d0-8ce7-477a-83d6-89f55f796ed3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1679 microversion: 2.1 time: 0.154622 Jul 29 04:56:09.690772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 451/912] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:09 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:10.711582 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:10.712189 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:10.719694 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:10.720140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:10.720920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:10.721358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:10.851322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:10.859717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5f2e007f-4273-4568-a1ba-b819a6427f21 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1679 microversion: 2.1 time: 0.151963 Jul 29 04:56:10.860286 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 462/913] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:10 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:11.881204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:11.881821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:11.888280 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:11.889273 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:11.890031 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:11.890471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:12.017508 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:12.025015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e52644e5-bd5c-493a-9f3e-bb1a154eeac5 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1679 microversion: 2.1 time: 0.147628 Jul 29 04:56:12.025584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 452/914] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:11 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:13.047078 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:13.047725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:13.054401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:13.054859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:13.055627 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:13.056073 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:13.186788 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:13.194298 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1905b8e9-315d-4675-bc2b-b8fe80a23eba tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1679 microversion: 2.1 time: 0.151756 Jul 29 04:56:13.194871 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 463/915] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:13 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:14.215263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:14.215878 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:14.223126 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:14.223585 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:14.224359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:14.224833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:14.356377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:14.364539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-71fff647-7f2f-45de-8f90-5fdade0d1061 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1679 microversion: 2.1 time: 0.152933 Jul 29 04:56:14.365139 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 453/916] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:14 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:15.078427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-f666d8e4-7b3b-44dc-8912-8fadeed9859e req-ec612360-c368-4e86-b0d8-4d605b483ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88854861-a8db-44a2-839b-5e158363e71c", "name": "network-vif-deleted", "tag": "afe03d9b-8522-41fb-a4a6-5dca887a6299"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:15.090806 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-f666d8e4-7b3b-44dc-8912-8fadeed9859e req-ec612360-c368-4e86-b0d8-4d605b483ff4 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:15.091278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-f666d8e4-7b3b-44dc-8912-8fadeed9859e req-ec612360-c368-4e86-b0d8-4d605b483ff4 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:15.104183 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-f666d8e4-7b3b-44dc-8912-8fadeed9859e req-ec612360-c368-4e86-b0d8-4d605b483ff4 service nova] Creating event network-vif-deleted:afe03d9b-8522-41fb-a4a6-5dca887a6299 for instance 88854861-a8db-44a2-839b-5e158363e71c on hv-cinder-85144 Jul 29 04:56:15.110200 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-f666d8e4-7b3b-44dc-8912-8fadeed9859e req-ec612360-c368-4e86-b0d8-4d605b483ff4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035954 Jul 29 04:56:15.112934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 464/917] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:15.386214 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:15.386890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:15.394604 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:15.395064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:15.395847 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:15.396295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:15.429344 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:15.429808 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:15.430263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lazy-loading 'fault' on Instance uuid 88854861-a8db-44a2-839b-5e158363e71c {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:56:15.470895 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:15.478399 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c1bf02bc-1fdc-49eb-b339-93a83b002c64 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 200 len: 1331 microversion: 2.1 time: 0.096196 Jul 29 04:56:15.478968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 454/918] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:15 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:16.501378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:16.502112 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:16.508796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:16.509250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:16.510010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:16.510450 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:16.523691 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c HTTP/1.1 Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:56:16.525354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:56:16.527030 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '88854861-a8db-44a2-839b-5e158363e71c'} Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:56:16.527977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:56:16.529585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:56:16.531354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:56:16.531354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-657f73f5-9b9a-4100-b393-67c86d245f74 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 404 len: 111 microversion: 2.1 time: 0.030322 Jul 29 04:56:16.531354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 465/919] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:16 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:56:16.536584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-06652f52-156a-4059-a536-0b1faceaecf2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '.version_select at 0x7f3c58b21940>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:16.556566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-06652f52-156a-4059-a536-0b1faceaecf2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509612079" status: 202 len: 0 microversion: 2.1 time: 0.023764 Jul 29 04:56:16.557146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 455/920] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Jul 29 04:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509612079 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:56:17.194003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-40a1d272-3d04-4c10-bf6f-8d04b5ce1574 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: .version_select at 0x7f3c542ba1f0>, body: {"keypair": {"name": "tempest-keypair-575968359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPs7kPlddydvYpGqjhjWV3Iu8tXEOo7mi+KUatm1WObbsF2G7sL8ux8+vj6I6GQFKI2ebTv1HAVSDIUGoICNE8zdNHQ43OjczeoiqILQ2oKqyDWMR78zsSiISJtGBBjstg=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:17.210120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-40a1d272-3d04-4c10-bf6f-8d04b5ce1574 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:56:17.214050 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-40a1d272-3d04-4c10-bf6f-8d04b5ce1574 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:56:17.236746 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-40a1d272-3d04-4c10-bf6f-8d04b5ce1574 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046596 Jul 29 04:56:17.237348 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 466/921] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 04:56:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:18.511400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-201822454", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21ca39e1-cfc7-4b5b-897b-220faf26ce68"}], "security_groups": [{"name": "tempest-securitygroup--599339788"}], "key_name": "tempest-keypair-575968359", "user_data": "}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:18.615157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] validate_networks() for [('21ca39e1-cfc7-4b5b-897b-220faf26ce68', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:56:18.978037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:56:18.978470 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:56:18.978951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:56:18.979368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:56:18.979787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:56:18.989006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:18.989461 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:18.990269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:18.990716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:19.007570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:56:19.011519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Getting quotas for user 572408fd157844dcae13000d8e9c4b7a and project 461e2af738084ccb986169d752510588. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:56:19.022991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:56:19.025257 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:56:19.070681 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-38b2960d-bde8-483d-a137-b547ad22bf50 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.564167 Jul 29 04:56:19.071494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 456/922] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:56:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:56:19.083481 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4c05ab77-dad6-463a-891a-3002b70d0652 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:19.084101 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4c05ab77-dad6-463a-891a-3002b70d0652 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:19.138154 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4c05ab77-dad6-463a-891a-3002b70d0652 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:19.145916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4c05ab77-dad6-463a-891a-3002b70d0652 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1240 microversion: 2.1 time: 0.066814 Jul 29 04:56:19.146484 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 467/923] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:19 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:56:20.166492 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:20.167099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:20.173201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:20.173654 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:20.174410 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:20.174846 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:20.234256 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:20.241638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-be321e1a-fbb4-443f-820a-f829918d802a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1244 microversion: 2.1 time: 0.079786 Jul 29 04:56:20.242190 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 457/924] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:20 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:21.262396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:21.262938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:21.269488 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:21.269953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:21.270894 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:21.271373 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:21.355431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:21.364905 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0dcfed47-f290-4cbd-81b3-c8b21c86eeb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1300 microversion: 2.1 time: 0.106449 Jul 29 04:56:21.365484 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 468/925] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:21 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:22.387170 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:22.387728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:22.394989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:22.395696 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:22.396469 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:22.396934 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:22.536998 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:22.545338 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b8a31d77-f790-4b58-80af-fed158e5dacf tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.162262 Jul 29 04:56:22.546502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 458/926] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:22 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:22.827835 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-190b5119-0f5d-4259-a966-32048b07ce6f req-ac561fb8-3e02-4937-8b29-8fd4327578d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e85f641-7d4e-4121-933b-e00793f410b0", "tag": "16945bc9-3458-44e2-a493-5680610d8654"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:22.839512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-190b5119-0f5d-4259-a966-32048b07ce6f req-ac561fb8-3e02-4937-8b29-8fd4327578d9 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:22.840200 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-190b5119-0f5d-4259-a966-32048b07ce6f req-ac561fb8-3e02-4937-8b29-8fd4327578d9 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:22.854081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-190b5119-0f5d-4259-a966-32048b07ce6f req-ac561fb8-3e02-4937-8b29-8fd4327578d9 service nova] Creating event network-changed:16945bc9-3458-44e2-a493-5680610d8654 for instance 3e85f641-7d4e-4121-933b-e00793f410b0 on hv-cinder-85144 Jul 29 04:56:22.860921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-190b5119-0f5d-4259-a966-32048b07ce6f req-ac561fb8-3e02-4937-8b29-8fd4327578d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037843 Jul 29 04:56:22.866921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 469/927] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:23.568481 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:23.569160 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:23.575833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:23.576291 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:23.577697 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:23.578247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:23.715522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:23.723094 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b959ab79-7e3a-4153-ab94-3f4b3261c377 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.158417 Jul 29 04:56:23.723664 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 459/928] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:23 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:24.745664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:24.747581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:24.753208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:24.753656 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:24.754427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:24.754861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:24.913680 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:24.923035 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1fdec358-ddc1-48fe-8b0c-95325c44d702 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.183004 Jul 29 04:56:24.923610 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 470/929] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:24 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:25.946485 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:25.948381 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:25.955952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:25.956388 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:25.957486 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:25.957924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:26.101502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:26.110032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-017d53bf-7a35-4330-9b89-86964a2a00ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.168275 Jul 29 04:56:26.110610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 460/930] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:25 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:27.131949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:27.132627 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:27.139179 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:27.140245 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:27.141144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:27.141593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:27.277010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:27.285747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b070c99f-3e46-4a8b-a399-a9eb316e518d tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.158104 Jul 29 04:56:27.286602 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 471/931] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:27 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:28.307910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:28.308515 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:28.316121 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:28.316318 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:28.316987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:28.317431 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:28.450978 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:28.459653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-25070062-20e8-4890-b824-f65abb12c2f8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.155499 Jul 29 04:56:28.460241 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 461/932] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:28 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:29.481557 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:29.482201 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:29.485561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:29.491940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:29.492396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:29.493404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:29.493849 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:29.674278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:29.682036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-536ec1cc-4221-4b8b-8085-29ff2b46a6a2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.204421 Jul 29 04:56:29.682615 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 472/933] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:29 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:30.703174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:30.704540 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:30.707644 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:30.708393 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:30.713512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:30.713967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:30.714942 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:30.715543 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:30.721616 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:30.787435 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-c6cf40d7-86e2-498c-a991-0be230a60429 req-44bcc232-ed18-4e21-bd8b-1677d919f614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e85f641-7d4e-4121-933b-e00793f410b0", "name": "network-vif-plugged", "status": "completed", "tag": "16945bc9-3458-44e2-a493-5680610d8654"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:30.801916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-c6cf40d7-86e2-498c-a991-0be230a60429 req-44bcc232-ed18-4e21-bd8b-1677d919f614 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:30.802603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-c6cf40d7-86e2-498c-a991-0be230a60429 req-44bcc232-ed18-4e21-bd8b-1677d919f614 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:30.817438 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-c6cf40d7-86e2-498c-a991-0be230a60429 req-44bcc232-ed18-4e21-bd8b-1677d919f614 service nova] Creating event network-vif-plugged:16945bc9-3458-44e2-a493-5680610d8654 for instance 3e85f641-7d4e-4121-933b-e00793f410b0 on hv-cinder-85144 Jul 29 04:56:30.823717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-c6cf40d7-86e2-498c-a991-0be230a60429 req-44bcc232-ed18-4e21-bd8b-1677d919f614 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040404 Jul 29 04:56:30.824807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 473/934] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:56:30.899118 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:30.907642 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-749f8e78-8bc2-4bb5-8d8d-d706ec684ed2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.208143 Jul 29 04:56:30.921871 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 462/935] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:30 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:31.930329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:31.931474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:31.938487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:31.938968 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:31.939620 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:31.940060 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:32.078242 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:32.085834 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4f1270ab-c291-4df8-9c81-6bae985d9b6a tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1365 microversion: 2.1 time: 0.160815 Jul 29 04:56:32.086401 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 474/936] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:31 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:33.111019 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:33.112937 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:33.117570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:33.122705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:33.123175 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:33.124717 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:33.125287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:33.432069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:33.441473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-642fd1be-0295-4df8-aa51-6732be72c932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1555 microversion: 2.1 time: 0.335269 Jul 29 04:56:33.442246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 463/937] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:33 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1555 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:33.462746 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6697802f-917b-4ddc-8c1a-72bb509ad544 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:33.463609 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6697802f-917b-4ddc-8c1a-72bb509ad544 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:33.466917 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:33.478229 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6697802f-917b-4ddc-8c1a-72bb509ad544 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:33.478923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6697802f-917b-4ddc-8c1a-72bb509ad544 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:33.479934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6697802f-917b-4ddc-8c1a-72bb509ad544 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:33.480586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6697802f-917b-4ddc-8c1a-72bb509ad544 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:33.500093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:33.566383 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6697802f-917b-4ddc-8c1a-72bb509ad544 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107720 Jul 29 04:56:33.566978 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 475/938] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Jul 29 04:56:33 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:34.482279 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-8ef9289c-4fb1-49db-9389-28fa6d67c8b0 req-0162dcf1-ce80-4c4d-8f41-a1322f76c88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e85f641-7d4e-4121-933b-e00793f410b0", "tag": "16945bc9-3458-44e2-a493-5680610d8654"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:34.493126 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-8ef9289c-4fb1-49db-9389-28fa6d67c8b0 req-0162dcf1-ce80-4c4d-8f41-a1322f76c88d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:34.493968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-8ef9289c-4fb1-49db-9389-28fa6d67c8b0 req-0162dcf1-ce80-4c4d-8f41-a1322f76c88d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:34.508041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-8ef9289c-4fb1-49db-9389-28fa6d67c8b0 req-0162dcf1-ce80-4c4d-8f41-a1322f76c88d service nova] Creating event network-changed:16945bc9-3458-44e2-a493-5680610d8654 for instance 3e85f641-7d4e-4121-933b-e00793f410b0 on hv-cinder-85144 Jul 29 04:56:34.513359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-8ef9289c-4fb1-49db-9389-28fa6d67c8b0 req-0162dcf1-ce80-4c4d-8f41-a1322f76c88d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034673 Jul 29 04:56:34.515106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 464/939] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:56:49.522977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:49.523898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:49.528294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-18224480-cb90-4f13-a06b-ad4b8550fd1d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:49.529551 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-18224480-cb90-4f13-a06b-ad4b8550fd1d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:49.537538 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18224480-cb90-4f13-a06b-ad4b8550fd1d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:49.538336 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18224480-cb90-4f13-a06b-ad4b8550fd1d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:49.539188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18224480-cb90-4f13-a06b-ad4b8550fd1d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:49.539696 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-18224480-cb90-4f13-a06b-ad4b8550fd1d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:49.566091 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-18224480-cb90-4f13-a06b-ad4b8550fd1d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/ips" status: 200 len: 150 microversion: 2.20 time: 0.044067 Jul 29 04:56:49.566871 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 476/940] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Jul 29 04:56:49 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:56:51.380553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:51.381448 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:51.384269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:51.384952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=12 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:56:51.390958 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:51.391444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:51.392217 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:51.392716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:51.416099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lazy-loading 'flavor' on Instance uuid 5e997be3-f342-420b-8630-ca1f8847303a {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:56:51.595350 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-fdf5939b-ed0d-4fe2-a8bb-afb50515b844 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/action" status: 202 len: 0 microversion: 2.20 time: 0.219612 Jul 29 04:56:51.596089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 465/941] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Jul 29 04:56:51 2022] POST /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:56:51.604800 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:51.605416 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:51.613128 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:51.613677 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:51.614511 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:51.615156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:51.621445 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1070127092", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "networks": [{"uuid": "f6122d12-dacd-40c0-a20f-9d53ca795a2c"}]}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:51.682750 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] validate_networks() for [('f6122d12-dacd-40c0-a20f-9d53ca795a2c', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:56:51.751041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:51.760079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:51.761738 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:51.762903 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-77acac97-1259-4cad-8f16-d189fb6eeda0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.161979 Jul 29 04:56:51.763455 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 477/942] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:51 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:56:52.028634 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:56:52.029101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:56:52.029667 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:56:52.030115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:56:52.030558 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:56:52.040210 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:52.040699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:52.041512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:52.041958 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:52.058897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Getting quotas for project 62319662d8e34fc8bbe01e0410cec30a. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:56:52.063056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Getting quotas for user 7136bb1746744ce89f74c1185c76d043 and project 62319662d8e34fc8bbe01e0410cec30a. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:56:52.073863 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:56:52.076159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:56:52.120942 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8538667f-f1e5-41ba-8aed-73c2aea0b819 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504597 Jul 29 04:56:52.121579 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 466/943] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:56:52.132250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-be68c171-e192-4c9a-838f-f873b306fe95 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:52.132884 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-be68c171-e192-4c9a-838f-f873b306fe95 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:52.188749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-be68c171-e192-4c9a-838f-f873b306fe95 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:52.195997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-be68c171-e192-4c9a-838f-f873b306fe95 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1219 microversion: 2.1 time: 0.067552 Jul 29 04:56:52.196574 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 478/944] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:52 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:52.787952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:52.788572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:52.795235 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:52.795686 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:52.796467 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:52.796937 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:52.929163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:52.937396 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:52.938913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:52.940174 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8e687af7-beb5-4cb7-a03b-daa365bf4f08 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.158019 Jul 29 04:56:52.940688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 467/945] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:52 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:56:53.217275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:53.217895 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:53.233273 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:53.236515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:53.238193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:53.238649 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:53.333375 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:53.341520 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ca523668-ed1c-4139-919f-7b1f15f0f520 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1289 microversion: 2.1 time: 0.128004 Jul 29 04:56:53.342197 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 479/946] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:53 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:53.963522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:53.964269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:53.970767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:53.971296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:53.972074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:53.972520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:54.106387 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:54.115436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:54.117084 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:54.118272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9952a15f-938b-4e9c-9aed-ba7b60927f4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.158746 Jul 29 04:56:54.119074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 468/947] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:53 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:56:54.363991 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:54.364625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:54.371194 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:54.371649 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:54.372419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:54.372892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:54.566387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:54.574249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b1369c44-abcb-4ec3-97ef-69c0783ff19f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.214760 Jul 29 04:56:54.574829 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 480/948] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:54 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:54.617836 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-8d313f49-c31c-4130-8783-12633f9b4750 req-c32e760b-a35c-40f7-b8cc-7c092f1ad72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27c1c2c-a7fb-4552-9ef0-9acafa894a99", "tag": "ac1f13bc-ec87-4b3e-b528-f2300635c000"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:56:54.628412 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-8d313f49-c31c-4130-8783-12633f9b4750 req-c32e760b-a35c-40f7-b8cc-7c092f1ad72b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:54.628942 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-8d313f49-c31c-4130-8783-12633f9b4750 req-c32e760b-a35c-40f7-b8cc-7c092f1ad72b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:54.641243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-8d313f49-c31c-4130-8783-12633f9b4750 req-c32e760b-a35c-40f7-b8cc-7c092f1ad72b service nova] Creating event network-changed:ac1f13bc-ec87-4b3e-b528-f2300635c000 for instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 on hv-cinder-85144 Jul 29 04:56:54.647138 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-8d313f49-c31c-4130-8783-12633f9b4750 req-c32e760b-a35c-40f7-b8cc-7c092f1ad72b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033254 Jul 29 04:56:54.647769 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 469/949] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:56:55.142318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:55.142865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:55.149578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:55.150022 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:55.150774 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:55.151208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:55.279372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:55.288456 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:55.290436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:55.291583 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bbd37641-2ca4-49b4-8327-393dfb6d3f04 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.153323 Jul 29 04:56:55.292137 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 481/950] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:55 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:56:55.598272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:55.598982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:55.605231 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:55.605692 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:55.606501 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:55.606945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:55.734810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:55.742946 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-739c719e-33e4-4201-b389-3c8bdff9a30f tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.150081 Jul 29 04:56:55.743506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 470/951] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:55 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:56.314784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:56.316043 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:56.322699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:56.323123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:56.323891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:56.324337 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:56.459480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:56.467462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:56.469016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:56.470215 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-293c432d-9295-4fb4-a19a-5f1c07b4b348 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.159408 Jul 29 04:56:56.470771 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 482/952] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:56 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:56:56.763399 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:56.764007 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:56.770989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:56.771442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:56.772231 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:56.772695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:56.899318 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:56.906682 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b64ba8e4-5161-4865-b538-a879f9b93ff8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.147091 Jul 29 04:56:56.907187 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 471/953] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:56 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:57.493157 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:57.493758 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:57.500237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:57.500716 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:57.501476 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:57.501913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:57.634616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:57.642899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:57.645561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:57.646741 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2c4acbe2-2415-420b-b1d4-f16e367bd87b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.157479 Jul 29 04:56:57.647345 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 483/954] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:57 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:56:57.927620 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:57.928159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:57.934684 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:57.935136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:57.935907 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:57.936348 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:58.067324 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:58.074777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e255bd82-a210-40fb-b569-6022d8236454 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.151366 Jul 29 04:56:58.075345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 472/955] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:57 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:58.670797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:58.671406 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:58.679156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:58.679608 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:58.680370 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:58.680844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:58.809767 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:58.817828 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:58.819329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:58.820479 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-330f635b-150f-4fce-9a46-e71ce9a4235f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.153685 Jul 29 04:56:58.821070 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 484/956] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:58 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:56:59.096932 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:59.097638 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:59.104082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:59.104558 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:59.105355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:59.105806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:59.236681 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:59.244233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1ba00b8a-9664-43ff-a1cf-3ef35e66a9d6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.151939 Jul 29 04:56:59.244835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 473/957] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:56:59 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:56:59.842709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:56:59.843326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:56:59.850136 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:59.850581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:59.851333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:56:59.851768 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:56:59.982822 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:59.990846 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:59.992362 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:56:59.993539 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-991454e7-2706-4af1-8566-a05b5f3fa47f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.154694 Jul 29 04:56:59.994094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 485/958] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:56:59 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:00.264817 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:00.265429 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:00.272424 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:00.272909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:00.273666 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:00.274099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:00.399877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:00.407330 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8b6a4a8b-5254-4c00-8d2c-aa1e05de2b82 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.146396 Jul 29 04:57:00.407903 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 474/959] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:57:00 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:57:00.928408 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-66c53cba-1f03-477d-bc10-02ae4b7517e8 req-5db3e740-043d-4765-95e8-0bbb5c7a7066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27c1c2c-a7fb-4552-9ef0-9acafa894a99", "name": "network-vif-plugged", "status": "completed", "tag": "ac1f13bc-ec87-4b3e-b528-f2300635c000"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:00.940769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-66c53cba-1f03-477d-bc10-02ae4b7517e8 req-5db3e740-043d-4765-95e8-0bbb5c7a7066 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:00.941235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-66c53cba-1f03-477d-bc10-02ae4b7517e8 req-5db3e740-043d-4765-95e8-0bbb5c7a7066 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:00.955423 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-66c53cba-1f03-477d-bc10-02ae4b7517e8 req-5db3e740-043d-4765-95e8-0bbb5c7a7066 service nova] Creating event network-vif-plugged:ac1f13bc-ec87-4b3e-b528-f2300635c000 for instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 on hv-cinder-85144 Jul 29 04:57:00.962132 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-66c53cba-1f03-477d-bc10-02ae4b7517e8 req-5db3e740-043d-4765-95e8-0bbb5c7a7066 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037544 Jul 29 04:57:00.962936 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 486/960] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:57:01.016558 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:01.017436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:01.024753 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:01.025202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:01.026000 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:01.026480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:01.166677 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:01.175477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:01.177005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:01.178501 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bcb3b3ff-2a5c-4c64-b431-b01806340418 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.166131 Jul 29 04:57:01.179076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 475/961] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:01 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:01.429565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:01.430219 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:01.436443 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:01.436935 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:01.437703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:01.438148 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:01.570191 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:01.577784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f9d59598-e0a0-4ce9-9a00-38d3fbafbefc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.152497 Jul 29 04:57:01.578348 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 487/962] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:57:01 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:57:02.201918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:02.202447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:02.204890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:02.206180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:02.212195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:02.212673 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:02.213446 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:02.213887 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:02.342163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:02.350967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:02.352506 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:02.353694 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d44c0dbb-bee9-4cea-9719-de7dcf7aa5c7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.155786 Jul 29 04:57:02.354247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 476/963] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:02 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:02.599142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:02.599783 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:02.602656 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:02.608437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:02.608920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:02.609702 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:02.610149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:02.743760 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:02.751302 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1b79644f-9c2d-45b5-9df9-02423ab21176 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1319 microversion: 2.1 time: 0.156221 Jul 29 04:57:02.751879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 488/964] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:57:02 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:57:03.376928 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:03.377585 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:03.384503 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:03.384996 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:03.385773 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:03.386221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:03.512641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:03.521163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:03.523134 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:03.524194 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1add111b-a1fa-44fc-99af-bd4a85e430f7 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.151212 Jul 29 04:57:03.524872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 477/965] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:03 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:03.773815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:03.774422 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:03.780638 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:03.781083 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:03.781843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:03.782281 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:03.916387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:03.923969 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-50898ec2-2261-439a-8800-f06c56276464 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1509 microversion: 2.1 time: 0.154061 Jul 29 04:57:03.925206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 489/966] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:57:03 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:57:04.548232 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:04.548913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:04.555544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:04.556003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:04.556764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:04.557379 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:04.700250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:04.708900 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:04.710429 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:04.711642 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4dd0c2e8-c36d-4c7f-bc10-16fd9e672f70 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.167251 Jul 29 04:57:04.712211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 478/967] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:04 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:05.738137 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:05.738740 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:05.745339 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:05.745791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:05.746562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:05.747002 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:05.882103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:05.890182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:05.891753 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:05.893000 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d9a2622e-7fe2-4fab-b100-025a57414b38 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.159394 Jul 29 04:57:05.893564 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 490/968] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:05 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:06.916432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:06.917026 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:06.923693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:06.924217 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:06.925108 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:06.925555 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:07.056836 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:07.064741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:07.066903 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:07.068069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0a4a1a8c-c034-483c-aa8e-cbd40d1ac0c0 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.156041 Jul 29 04:57:07.068853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 479/969] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:06 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:08.090925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:08.091446 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:08.098637 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:08.099085 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:08.099838 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:08.100272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:08.233103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:08.245220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:08.246776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:08.247976 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-79feb773-a755-4182-a7d7-bdcfb8975b0a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.161082 Jul 29 04:57:08.248589 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 491/970] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:08 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:09.270798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:09.271416 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:09.277966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:09.278426 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:09.279200 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:09.279643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:09.419549 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:09.423077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:09.429698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:09.431225 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:09.432403 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-738131fa-2cbd-4dff-a1c4-55e53fdd3d07 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1742 microversion: 2.20 time: 0.165592 Jul 29 04:57:09.433000 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 480/971] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:09 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:10.455757 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:10.456351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:10.462525 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:10.462952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:10.463706 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:10.464142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:10.598236 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:10.607074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:10.608693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:10.609826 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-69a57e1e-f0d6-47fe-86ee-d2fcb112f2da tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1742 microversion: 2.20 time: 0.158245 Jul 29 04:57:10.610382 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 492/972] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:10 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:11.633723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:11.634341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:11.642301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:11.642808 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:11.643718 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:11.644168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:11.776012 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:11.785465 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:11.787037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:11.788478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b51c6e06-d2a6-47a7-bc97-e023f92e47f2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1742 microversion: 2.20 time: 0.158771 Jul 29 04:57:11.789076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 481/973] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:11 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:12.811352 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:12.811962 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:12.819320 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:12.819782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:12.820560 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:12.821038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:12.959911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:12.968013 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:12.969560 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:12.970868 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a7649ecb-1b9a-49f0-bb01-2535bf2e25b3 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1742 microversion: 2.20 time: 0.163507 Jul 29 04:57:12.971685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 493/974] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:12 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:12.992771 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-682a418d-66f9-4f40-914d-40f37d2d5a23 req-29336ea8-705c-4fb2-8288-5d1d777a391b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e997be3-f342-420b-8630-ca1f8847303a", "name": "network-vif-plugged", "status": "completed", "tag": "89c67e7e-2b75-46a8-b24e-d4b2cd7a0832"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:13.003000 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-682a418d-66f9-4f40-914d-40f37d2d5a23 req-29336ea8-705c-4fb2-8288-5d1d777a391b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:13.003516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-682a418d-66f9-4f40-914d-40f37d2d5a23 req-29336ea8-705c-4fb2-8288-5d1d777a391b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:13.017398 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-682a418d-66f9-4f40-914d-40f37d2d5a23 req-29336ea8-705c-4fb2-8288-5d1d777a391b service nova] Creating event network-vif-plugged:89c67e7e-2b75-46a8-b24e-d4b2cd7a0832 for instance 5e997be3-f342-420b-8630-ca1f8847303a on hv-cinder-85144 Jul 29 04:57:13.023357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-682a418d-66f9-4f40-914d-40f37d2d5a23 req-29336ea8-705c-4fb2-8288-5d1d777a391b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035630 Jul 29 04:57:13.023961 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 482/975] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:57:13.995379 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:13.995984 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:14.002470 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:14.002913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:14.004167 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:14.004645 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:14.024529 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:14.141505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:14.150244 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:14.151776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:14.152974 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9c9ee4ba-b313-49d2-9bc1-9d6e0e34359b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1742 microversion: 2.20 time: 0.161538 Jul 29 04:57:14.153533 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 494/976] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:13 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:15.176945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:15.177655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:15.184346 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:15.184849 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:15.185623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:15.186071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:15.313899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:15.322429 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:15.323939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:15.325157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-43ba5c0e-7b13-4c91-b6f4-ba6816bcd515 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1742 microversion: 2.20 time: 0.153065 Jul 29 04:57:15.325711 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 483/977] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:15 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:16.348625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:16.349288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:16.355859 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:16.356316 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:16.357114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:16.357559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:16.488361 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:16.496622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:16.498127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:16.499314 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e808ab89-0296-48f0-81b7-c174f2b6ecf1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1742 microversion: 2.20 time: 0.155442 Jul 29 04:57:16.499873 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 495/978] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:16 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:17.522880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:17.523498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:17.530330 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:17.531126 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:17.532109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:17.532557 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:17.683735 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:17.692665 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:17.694208 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:17.695392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4842478a-5f97-4bb8-a276-15e931d47f99 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.176934 Jul 29 04:57:17.695945 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 484/979] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:17 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:18.719624 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:18.720288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:18.728122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:18.728910 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:18.729718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:18.730436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:18.867799 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:18.876672 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:18.879052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:18.880241 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-007fe89c-dfba-4994-a812-0d2ce07bf70c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.164819 Jul 29 04:57:18.893284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 496/980] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:18 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:19.904671 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:19.905325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:19.912441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:19.913212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:19.914522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:19.915218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:20.176860 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:20.184861 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:20.186397 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:20.187572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-afa60ff3-c6fa-4e1d-b196-b5697e966fff tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.286883 Jul 29 04:57:20.188129 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 485/981] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:19 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:20.928482 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ff7bffca-041d-4123-a8ab-5813b2d8eff8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:20.929080 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ff7bffca-041d-4123-a8ab-5813b2d8eff8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:20.932434 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=45 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:20.936406 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff7bffca-041d-4123-a8ab-5813b2d8eff8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:20.937193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff7bffca-041d-4123-a8ab-5813b2d8eff8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:20.938166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff7bffca-041d-4123-a8ab-5813b2d8eff8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:20.938770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ff7bffca-041d-4123-a8ab-5813b2d8eff8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:20.965652 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ff7bffca-041d-4123-a8ab-5813b2d8eff8 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/ips" status: 200 len: 146 microversion: 2.1 time: 0.041985 Jul 29 04:57:20.966316 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 497/982] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:57:20 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:57:21.210729 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:21.211770 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:21.220432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:21.221282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:21.222485 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:21.223136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:21.368287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:21.376928 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:21.379113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:21.380285 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-439abb0e-9790-479a-be15-85e3527ef5c2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.173890 Jul 29 04:57:21.380876 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 486/983] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:21 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:22.403666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:22.404289 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:22.411602 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:22.412143 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:22.412954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:22.413432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:22.605973 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:22.614989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:22.616512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:22.617712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8fc8da87-5180-4223-a3e4-5277cabef209 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.218362 Jul 29 04:57:22.618269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 498/984] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:22 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:23.400401 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2ecc768f-edd1-424f-94c4-4a3e96eb17bf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39f7235e-885a-47af-97a4-65596c0d143b"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:23.403868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2ecc768f-edd1-424f-94c4-4a3e96eb17bf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:23.408693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:23.414601 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ecc768f-edd1-424f-94c4-4a3e96eb17bf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:23.415301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ecc768f-edd1-424f-94c4-4a3e96eb17bf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:23.417145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ecc768f-edd1-424f-94c4-4a3e96eb17bf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:23.417657 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2ecc768f-edd1-424f-94c4-4a3e96eb17bf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:23.643454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:23.644837 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:23.657083 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:23.657738 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:23.658677 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:23.659276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:23.698983 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2ecc768f-edd1-424f-94c4-4a3e96eb17bf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302640 Jul 29 04:57:23.699840 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 487/985] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:57:23 2022] POST /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:57:23.841792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:23.850648 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:23.852165 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:23.853358 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0e87f725-7ffb-4f8b-ac18-7d14429dd98c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.215688 Jul 29 04:57:23.853928 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 499/986] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:23 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:57:24.877158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:24.877870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:24.884991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:24.885455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:24.886237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:24.886695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:25.031603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:25.039875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:25.041404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:25.042551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5273c7af-c2d4-4fe8-bb23-f2985fcd30ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.170241 Jul 29 04:57:25.043354 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 488/987] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:24 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:26.066209 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:26.066858 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:26.073806 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:26.074261 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:26.075041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:26.075499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:26.217532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:26.226660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:26.228724 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:26.230360 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-40c222ab-cdc5-4f16-a952-72ce7b5f897e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.168083 Jul 29 04:57:26.232642 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 500/988] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:26 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:27.254033 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:27.256921 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:27.263359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:27.264116 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:27.265152 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:27.265802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:27.415766 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:27.423846 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:27.425407 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:27.427268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-789f9bc8-f67d-424f-b8cd-3529f56445c5 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.176507 Jul 29 04:57:27.427871 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 489/989] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:27 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:28.451134 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:28.451690 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:28.458624 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:28.459583 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:28.460490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:28.460853 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:28.609420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:28.620377 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:28.621973 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:28.623158 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-17b51794-b0a8-4d81-9ffe-f63a6c99b299 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.176792 Jul 29 04:57:28.623699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 501/990] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:28 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:28.638477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e5236018-9dfc-4f81-8481-0981253937ce tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9c286fc-7b5f-44b4-b28d-0914a4e2f0d2", "device": "/dev/sdb"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:28.641616 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e5236018-9dfc-4f81-8481-0981253937ce tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:28.651382 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5236018-9dfc-4f81-8481-0981253937ce tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:28.652017 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5236018-9dfc-4f81-8481-0981253937ce tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:28.652884 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5236018-9dfc-4f81-8481-0981253937ce tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:28.653346 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e5236018-9dfc-4f81-8481-0981253937ce tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:28.930351 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e5236018-9dfc-4f81-8481-0981253937ce tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "POST /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295267 Jul 29 04:57:28.931071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 490/991] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:57:28 2022] POST /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:57:29.646919 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:29.647515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:29.654532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:29.655371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:29.655752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:29.656359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:29.807274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:29.816649 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:29.816873 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:29.818710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-74f62199-1d58-47b9-9434-314222fd840e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.175941 Jul 29 04:57:29.819308 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 502/992] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:29 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:30.842823 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:30.843546 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:30.850647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:30.851121 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:30.852052 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:30.852645 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:31.241964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:31.250166 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:31.253111 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:31.254368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a3e19f14-fc0a-42b3-b682-ae6de148e783 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1737 microversion: 2.20 time: 0.415956 Jul 29 04:57:31.255896 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 491/993] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:30 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1737 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:31.301468 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ad86d8ea-bf73-4b16-bd5d-ce43725c989c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:31.303699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ad86d8ea-bf73-4b16-bd5d-ce43725c989c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:31.310328 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad86d8ea-bf73-4b16-bd5d-ce43725c989c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:31.310784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad86d8ea-bf73-4b16-bd5d-ce43725c989c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:31.311562 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad86d8ea-bf73-4b16-bd5d-ce43725c989c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:31.312037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ad86d8ea-bf73-4b16-bd5d-ce43725c989c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:31.342107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ad86d8ea-bf73-4b16-bd5d-ce43725c989c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Jul 29 04:57:31.342665 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 503/994] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:57:31 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:57:31.353461 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-47f75137-5797-4247-b029-12f871512760 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:31.353976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-47f75137-5797-4247-b029-12f871512760 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:31.359846 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-47f75137-5797-4247-b029-12f871512760 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:31.360301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-47f75137-5797-4247-b029-12f871512760 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:31.361095 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-47f75137-5797-4247-b029-12f871512760 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:31.361535 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-47f75137-5797-4247-b029-12f871512760 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:31.390463 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-47f75137-5797-4247-b029-12f871512760 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/39f7235e-885a-47af-97a4-65596c0d143b" status: 200 len: 194 microversion: 2.1 time: 0.040949 Jul 29 04:57:31.391050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 492/995] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Jul 29 04:57:31 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/39f7235e-885a-47af-97a4-65596c0d143b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:57:32.278319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:32.278930 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:32.285113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:32.285566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:32.286938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:32.287381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:32.290733 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 04:57:32.292220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 04:57:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a (ip 10.222.0.40) !!! Jul 29 04:57:32.499786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:32.508585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:32.510149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:32.511318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-dee313bc-9a62-42b7-87e9-f9ce858dd754 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1719 microversion: 2.20 time: 0.236954 Jul 29 04:57:32.511977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 504/996] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:32 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1719 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:32.716424 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-79535549-5aab-4804-bbb4-2dc30e830250 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5b10df4-9103-48e3-a88a-cc76376db554"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:32.718897 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-79535549-5aab-4804-bbb4-2dc30e830250 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:32.725989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79535549-5aab-4804-bbb4-2dc30e830250 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:32.726442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79535549-5aab-4804-bbb4-2dc30e830250 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:32.727208 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79535549-5aab-4804-bbb4-2dc30e830250 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:32.727647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79535549-5aab-4804-bbb4-2dc30e830250 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:33.535256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:33.535911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:33.542904 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:33.543368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:33.544136 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:33.544630 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:33.680842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:33.688811 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:33.690331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:33.691496 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f5b2c9e2-153c-4ede-8385-c63e2b4aeb9c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1719 microversion: 2.20 time: 0.160196 Jul 29 04:57:33.692649 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 505/997] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:33 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 04:57:34.295010 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-79535549-5aab-4804-bbb4-2dc30e830250 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "POST /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.582351 Jul 29 04:57:34.295611 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 493/998] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:57:32 2022] POST /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments => generated 194 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:57:34.715653 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:34.716323 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:34.724132 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:34.724576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:34.725359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:34.725801 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:34.858643 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:34.866607 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:34.868125 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:34.869322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3306d64d-f5a5-483b-986e-b6d8b0938e8a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1722 microversion: 2.20 time: 0.157693 Jul 29 04:57:34.869885 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 506/999] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:34 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:34.893198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0561a673-3890-49a1-b53b-1cbaf04ce93a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d2e502d-8c9b-4be3-9700-94bd9eb6358e"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:34.896382 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0561a673-3890-49a1-b53b-1cbaf04ce93a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:34.902573 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0561a673-3890-49a1-b53b-1cbaf04ce93a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:34.903032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0561a673-3890-49a1-b53b-1cbaf04ce93a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:34.903809 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0561a673-3890-49a1-b53b-1cbaf04ce93a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:34.904308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0561a673-3890-49a1-b53b-1cbaf04ce93a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:34.908036 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:35.050447 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-e8131f97-b465-434e-ae70-c6a5b99851e5 req-cd9668aa-f9f4-41cd-926d-50f060970101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e997be3-f342-420b-8630-ca1f8847303a", "name": "network-vif-unplugged", "status": "completed", "tag": "89c67e7e-2b75-46a8-b24e-d4b2cd7a0832"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:35.060723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-e8131f97-b465-434e-ae70-c6a5b99851e5 req-cd9668aa-f9f4-41cd-926d-50f060970101 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:35.061185 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-e8131f97-b465-434e-ae70-c6a5b99851e5 req-cd9668aa-f9f4-41cd-926d-50f060970101 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:35.075429 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.compute.server_external_events [req-e8131f97-b465-434e-ae70-c6a5b99851e5 req-cd9668aa-f9f4-41cd-926d-50f060970101 service nova] Unable to find a host for instance 5e997be3-f342-420b-8630-ca1f8847303a. Dropping event network-vif-unplugged {{(pid=129684) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 04:57:35.076413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-e8131f97-b465-434e-ae70-c6a5b99851e5 req-cd9668aa-f9f4-41cd-926d-50f060970101 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029921 Jul 29 04:57:35.077053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 507/1000] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 29 04:57:35.195471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0561a673-3890-49a1-b53b-1cbaf04ce93a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307053 Jul 29 04:57:35.196088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 494/1001] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Jul 29 04:57:34 2022] POST /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 04:57:35.319476 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ab0136bf-aa0e-4de9-b634-ad50d0cea9e9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:35.319982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ab0136bf-aa0e-4de9-b634-ad50d0cea9e9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:35.326048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ab0136bf-aa0e-4de9-b634-ad50d0cea9e9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:35.326505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ab0136bf-aa0e-4de9-b634-ad50d0cea9e9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:35.327270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ab0136bf-aa0e-4de9-b634-ad50d0cea9e9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:35.327712 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ab0136bf-aa0e-4de9-b634-ad50d0cea9e9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:35.570554 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ab0136bf-aa0e-4de9-b634-ad50d0cea9e9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-volume_attachments/3d2e502d-8c9b-4be3-9700-94bd9eb6358e" status: 202 len: 0 microversion: 2.20 time: 0.255625 Jul 29 04:57:35.571145 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 508/1002] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Jul 29 04:57:35 2022] DELETE /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-volume_attachments/3d2e502d-8c9b-4be3-9700-94bd9eb6358e => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:57:35.628284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:57:35.628914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:35.636114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:35.636575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:35.637376 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:35.637827 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:35.668372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129683) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 04:57:35.732640 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e99e84b5-423b-4936-a2bb-ef458d1fe1cb tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "POST /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/action" status: 202 len: 0 microversion: 2.20 time: 0.108212 Jul 29 04:57:35.733282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 495/1003] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Jul 29 04:57:35 2022] POST /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:57:35.742079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:35.742704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:35.748989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:35.749458 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:35.750230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:35.750673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:35.913569 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:35.916135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:35.924312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:35.926056 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:35.927243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d833db70-7269-4bc1-89c3-059460070a41 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1670 microversion: 2.20 time: 0.189854 Jul 29 04:57:35.927797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 509/1004] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:35 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:36.951021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:36.951633 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:36.958150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:36.958610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:36.959382 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:36.959825 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:37.090083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:37.098417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:37.099965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:37.101325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5c986443-8a44-491c-8d20-7bc65a78d29d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.154801 Jul 29 04:57:37.101896 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 496/1005] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:36 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:38.124856 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:38.125466 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:38.133585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:38.134036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:38.134811 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:38.135263 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:38.277910 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:38.285864 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:38.287571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:38.288799 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ddfc651b-f7b3-43e3-94d1-3854918d916a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.168248 Jul 29 04:57:38.289639 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 510/1006] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:38 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:39.311796 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:39.312496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:39.320144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:39.320625 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:39.321419 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:39.321868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:39.455783 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:39.464365 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:39.465928 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:39.467120 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f9ac1357-24dc-4521-9dd0-995705c7258a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.159607 Jul 29 04:57:39.468085 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 497/1007] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:39 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:40.492509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:40.494077 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:40.501023 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:40.501567 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:40.502558 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:40.503068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:40.876434 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:40.884999 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:40.886515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:40.887709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a762c7a8-c855-4e2d-b31f-3b162762d1cd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.399972 Jul 29 04:57:40.888310 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 511/1008] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:40 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:41.911265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:41.911810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:41.918467 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:41.918918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:41.919673 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:41.920109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:42.067022 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:42.076002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:42.077529 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:42.078690 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-05031640-b84d-439e-b9c6-02882f1a5fcd tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.171517 Jul 29 04:57:42.079245 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 498/1009] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:41 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:43.101404 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:43.102020 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:43.108843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:43.109309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:43.110051 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:43.110516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:43.236902 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:43.245416 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:43.246904 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:43.248043 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b87c62fd-5e89-4b7e-bb05-588e32e86401 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.150609 Jul 29 04:57:43.248617 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 512/1010] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:43 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:44.271801 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:44.272744 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:44.279263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:44.279806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:44.280679 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:44.281341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:44.424628 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:44.436932 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:44.438460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:44.439664 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-727921ed-5e75-4311-a054-8afce77a86dc tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.172825 Jul 29 04:57:44.451691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 499/1011] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:44 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:45.464006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:45.464628 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:45.471217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:45.471665 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:45.472417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:45.472879 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:45.604236 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:45.612139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:45.613700 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:45.614868 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0199d47e-8120-4a4b-a173-b2434e278a1a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.155506 Jul 29 04:57:45.616104 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 513/1012] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:45 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:46.638253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:46.638819 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:46.645535 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:46.646198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:46.647814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:46.648921 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:46.787516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:46.795941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:46.797522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:46.798688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-17d3ce04-428f-46ec-9849-368648db383c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.164404 Jul 29 04:57:46.799246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 500/1013] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:46 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:47.822729 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:47.823463 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:47.830208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:47.830661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:47.831436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:47.831876 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:47.966449 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:47.975140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:47.976796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:47.977989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d9db2110-94f1-4acb-9914-97ca9fc4a2ac tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.159509 Jul 29 04:57:47.978561 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 514/1014] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:47 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:49.001370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:49.001975 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:49.008523 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:49.009015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:49.009800 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:49.010243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:49.141410 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:49.149266 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:49.150767 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:49.151912 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9c80c18e-f069-41db-8225-67b3b5328a8e tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.154668 Jul 29 04:57:49.152465 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 501/1015] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:48 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:50.175724 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:50.176651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:50.184456 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:50.184934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:50.185705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:50.186174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:50.350619 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:50.361664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:50.363405 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:50.364782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bd3e2b91-a9e9-4b5f-8248-04a8ef743b36 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.193238 Jul 29 04:57:50.365472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 515/1016] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:50 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:51.388496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:51.388496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:51.395772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:51.396228 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:51.397185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:51.397635 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:51.541071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:51.549286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:51.550805 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:51.551982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3eca4aae-ce6b-46c8-a9b2-5a6b2c68c571 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.168375 Jul 29 04:57:51.552545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 502/1017] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:51 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:52.576010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:52.576741 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:52.579230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=38 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:52.585266 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:52.585797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:52.586570 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:52.587014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:52.719363 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:52.727827 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:52.729576 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:52.730747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5600ab50-d80a-4ff0-9826-f267520018a2 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.158731 Jul 29 04:57:52.731311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 516/1018] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:52 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:53.754295 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:53.754914 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:53.757583 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:57:53.762939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:53.763395 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:53.764172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:53.764636 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:53.900027 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:53.908688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:53.910213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:53.911516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-59d8856a-02ac-4ece-a4c9-78ab99ab4f83 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.161176 Jul 29 04:57:53.912651 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 503/1019] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:53 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:54.936301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:54.940690 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:54.948152 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:54.948647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:54.949432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:54.949883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:55.079245 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:55.088133 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:55.089691 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:55.090862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2ef10079-ae65-4e2c-af28-7d35c83c0d28 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.159835 Jul 29 04:57:55.091428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 517/1020] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:54 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:56.112929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:56.113478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:56.120650 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:56.121104 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:56.121865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:56.122305 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:56.255017 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:56.263798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:56.265356 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:56.266519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2039e471-6388-4f8d-bf54-ee4ed8097a4a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.157628 Jul 29 04:57:56.267074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 504/1021] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:56 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:57.289989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:57.290604 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:57.297280 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:57.297744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:57.298514 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:57.298961 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:57.427284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:57.435187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:57.436723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:57.437890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-7710f72b-170d-47f8-ae63-6a080b5a71e8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.152338 Jul 29 04:57:57.438462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 518/1022] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:57 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:58.461115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:58.461719 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:58.468286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:58.468813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:58.469602 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:58.470058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:58.598687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:58.606890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:58.608417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:58.609633 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d4b82db5-f9e3-463f-ac5d-ac896b041b92 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.153058 Jul 29 04:57:58.610189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 505/1023] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:58 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:57:59.632955 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:57:59.633574 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:57:59.639973 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:59.640423 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:59.641213 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:57:59.641652 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:57:59.768508 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:59.776973 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:59.778484 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:57:59.779635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-833125ed-9362-486a-8f9e-e001091fdb7b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.150833 Jul 29 04:57:59.780202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 519/1024] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:57:59 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:00.804163 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:00.804857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:00.811513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:00.811965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:00.812764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:00.813201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:00.958680 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:00.967967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:00.969861 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:00.971156 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0ec05824-7c7a-40c6-a546-e48a6bbdcaf8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.171566 Jul 29 04:58:00.971773 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 506/1025] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:00 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:01.995276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:01.995934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:02.003473 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:02.003917 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:02.004702 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:02.005140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:02.143237 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:02.151957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:02.153471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:02.154622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-132ce852-5095-4a52-90af-9763f5d98152 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.163383 Jul 29 04:58:02.155200 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 520/1026] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:01 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:03.093514 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7cbc4f94-ab5f-4169-a8db-b9cbfb29077f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:03.095781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7cbc4f94-ab5f-4169-a8db-b9cbfb29077f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:03.102844 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7cbc4f94-ab5f-4169-a8db-b9cbfb29077f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.103302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7cbc4f94-ab5f-4169-a8db-b9cbfb29077f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.104080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7cbc4f94-ab5f-4169-a8db-b9cbfb29077f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.104520 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7cbc4f94-ab5f-4169-a8db-b9cbfb29077f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.108220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:03.138365 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7cbc4f94-ab5f-4169-a8db-b9cbfb29077f tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048702 Jul 29 04:58:03.138798 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 507/1027] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:58:03 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:58:03.177255 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:03.177872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:03.184954 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.185416 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.186187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.186640 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.279335 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5366d0b2-3e12-49f0-9d3a-9fd95ac80bbf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:03.279846 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5366d0b2-3e12-49f0-9d3a-9fd95ac80bbf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:03.286089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5366d0b2-3e12-49f0-9d3a-9fd95ac80bbf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.286551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5366d0b2-3e12-49f0-9d3a-9fd95ac80bbf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.287330 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5366d0b2-3e12-49f0-9d3a-9fd95ac80bbf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.287838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5366d0b2-3e12-49f0-9d3a-9fd95ac80bbf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.320203 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:03.320361 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5366d0b2-3e12-49f0-9d3a-9fd95ac80bbf tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/39f7235e-885a-47af-97a4-65596c0d143b" status: 200 len: 194 microversion: 2.1 time: 0.045070 Jul 29 04:58:03.326125 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 508/1028] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Jul 29 04:58:03 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/39f7235e-885a-47af-97a4-65596c0d143b => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:58:03.329850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:03.331326 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:03.331815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:03.331956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:03.333122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-307c7408-697d-43d0-bd95-0433745a2d29 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.159848 Jul 29 04:58:03.333748 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 521/1029] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:03 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:03.338408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.338871 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.339713 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:03.340164 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:03.425596 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'services' on Instance uuid a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:03.498624 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b46b913a-8dc1-4ec8-bbed-fdaf304e8cee tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/39f7235e-885a-47af-97a4-65596c0d143b" status: 202 len: 0 microversion: 2.1 time: 0.171131 Jul 29 04:58:03.499211 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 509/1030] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:58:03 2022] DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/39f7235e-885a-47af-97a4-65596c0d143b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:58:04.358113 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:04.358748 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:04.365176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:04.365625 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:04.366908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:04.367346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:04.499507 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:04.508581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:04.510135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:04.511304 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1f208a3e-0ba8-42ae-b1d4-c0bfdbe592be tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.157086 Jul 29 04:58:04.511871 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 522/1031] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:04 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:05.277910 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:05.278509 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:05.284700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.285165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.285954 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.286404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.303055 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-953672cb-b5ff-4e3b-bf4b-443732689c70 req-13b3da94-ee3f-441f-8f3d-a0bcb691d319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e997be3-f342-420b-8630-ca1f8847303a", "name": "network-vif-plugged", "status": "completed", "tag": "89c67e7e-2b75-46a8-b24e-d4b2cd7a0832"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:05.313431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-953672cb-b5ff-4e3b-bf4b-443732689c70 req-13b3da94-ee3f-441f-8f3d-a0bcb691d319 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.313982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-953672cb-b5ff-4e3b-bf4b-443732689c70 req-13b3da94-ee3f-441f-8f3d-a0bcb691d319 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.328915 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-953672cb-b5ff-4e3b-bf4b-443732689c70 req-13b3da94-ee3f-441f-8f3d-a0bcb691d319 service nova] Creating event network-vif-plugged:89c67e7e-2b75-46a8-b24e-d4b2cd7a0832 for instance 5e997be3-f342-420b-8630-ca1f8847303a on hv-cinder-85144 Jul 29 04:58:05.334120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-953672cb-b5ff-4e3b-bf4b-443732689c70 req-13b3da94-ee3f-441f-8f3d-a0bcb691d319 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Jul 29 04:58:05.334720 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 523/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:58:05.376642 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lazy-loading 'services' on Instance uuid e27c1c2c-a7fb-4552-9ef0-9acafa894a99 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:05.453299 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bc090179-fca2-4506-a6f5-2ce48952b77e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99/os-volume_attachments/c9c286fc-7b5f-44b4-b28d-0914a4e2f0d2" status: 202 len: 0 microversion: 2.1 time: 0.180501 Jul 29 04:58:05.453899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 510/1033] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:58:05 2022] DELETE /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99/os-volume_attachments/c9c286fc-7b5f-44b4-b28d-0914a4e2f0d2 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:58:05.536749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:05.538219 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:05.545312 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.545770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.546545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.546988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.688952 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-09f7016b-dc9e-4026-981f-02a9aa29e6cd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:05.689469 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-09f7016b-dc9e-4026-981f-02a9aa29e6cd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:05.696434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09f7016b-dc9e-4026-981f-02a9aa29e6cd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.696928 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09f7016b-dc9e-4026-981f-02a9aa29e6cd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.697713 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09f7016b-dc9e-4026-981f-02a9aa29e6cd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.698161 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-09f7016b-dc9e-4026-981f-02a9aa29e6cd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.719952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:05.727643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-09f7016b-dc9e-4026-981f-02a9aa29e6cd tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/b5b10df4-9103-48e3-a88a-cc76376db554" status: 200 len: 194 microversion: 2.1 time: 0.043194 Jul 29 04:58:05.728247 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 511/1034] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Jul 29 04:58:05 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/b5b10df4-9103-48e3-a88a-cc76376db554 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:58:05.729011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:05.730695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:05.731983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d6b96992-e7d7-41ee-abf3-94abb6d40615 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.201094 Jul 29 04:58:05.732632 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 524/1035] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:05 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:05.738333 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:05.738832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:05.746455 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.746996 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.747779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:05.748246 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:05.831460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'services' on Instance uuid a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:05.901524 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f33114cb-044f-49f9-aa1a-38e4e40220c2 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/b5b10df4-9103-48e3-a88a-cc76376db554" status: 202 len: 0 microversion: 2.1 time: 0.166654 Jul 29 04:58:05.902144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 512/1036] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:58:05 2022] DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments/b5b10df4-9103-48e3-a88a-cc76376db554 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 04:58:06.755573 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:06.756179 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:06.763602 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:06.764043 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:06.764824 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:06.765267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:06.891656 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:06.900275 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:06.901817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:06.902965 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e311e2f6-08d0-40d6-87a2-9bb4518ac742 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.151308 Jul 29 04:58:06.903520 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 525/1037] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:06 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:07.639201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:07.639852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:07.646010 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:07.646460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:07.647220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:07.647708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:07.674437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:58:07.750233 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e119be13-ca2f-413d-a2db-35f69eba1424 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 204 len: 0 microversion: 2.1 time: 0.115696 Jul 29 04:58:07.751527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 513/1038] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:58:07 2022] DELETE /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:58:07.760177 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:07.760916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:07.767465 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:07.767925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:07.768802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:07.769264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:07.911610 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:07.920733 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3c850451-a025-4fcc-b72a-62660f57abe7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1515 microversion: 2.1 time: 0.164897 Jul 29 04:58:07.921368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 526/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:07 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:07.927490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:07.928203 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:07.935589 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:07.936280 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:07.937099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:07.937545 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:08.086332 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:08.090682 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:08.092300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:08.095962 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bbc79677-d54a-407a-a205-788dcb33673a tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.170402 Jul 29 04:58:08.097079 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 514/1040] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:07 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:08.943006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:08.943566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:08.950683 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:08.951137 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:08.951909 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:08.952353 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:08.955040 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:09.094600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:09.103326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5146e310-3f1f-466c-975b-846d59dac6d5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1515 microversion: 2.1 time: 0.164319 Jul 29 04:58:09.103897 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 527/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:08 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:09.120444 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:09.121093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:09.127263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:09.127709 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:09.128482 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:09.128959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:09.260567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:09.268610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:09.270145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:09.271310 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f09fb0a7-b1d8-4b07-aa3e-46bb9a66035d tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1728 microversion: 2.20 time: 0.156029 Jul 29 04:58:09.271869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 515/1042] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:09 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:10.124500 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:10.125142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:10.131145 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.131591 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.132362 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.132849 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.253644 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-477966ab-01ec-495e-9693-a9c77a968c1b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:10.255988 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-477966ab-01ec-495e-9693-a9c77a968c1b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:10.263073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-477966ab-01ec-495e-9693-a9c77a968c1b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.263519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-477966ab-01ec-495e-9693-a9c77a968c1b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.264311 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-477966ab-01ec-495e-9693-a9c77a968c1b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.264776 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-477966ab-01ec-495e-9693-a9c77a968c1b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.267038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:10.274796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cd9d1a3f-6759-42f2-8fdf-0689d85b2f4d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1515 microversion: 2.1 time: 0.154244 Jul 29 04:58:10.275462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 528/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:10 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:10.298303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-477966ab-01ec-495e-9693-a9c77a968c1b tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048528 Jul 29 04:58:10.298991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 516/1044] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:58:10 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 04:58:10.299334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:10.300122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:10.307271 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.308480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.309728 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.310378 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.425467 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-14db7512-53ed-47ec-8b99-75d432e8763d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:10.427698 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-14db7512-53ed-47ec-8b99-75d432e8763d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:10.434778 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-14db7512-53ed-47ec-8b99-75d432e8763d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.435307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-14db7512-53ed-47ec-8b99-75d432e8763d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.436185 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-14db7512-53ed-47ec-8b99-75d432e8763d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.436868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-14db7512-53ed-47ec-8b99-75d432e8763d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.467948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-14db7512-53ed-47ec-8b99-75d432e8763d tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046638 Jul 29 04:58:10.468519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 517/1045] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:58:10 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:58:10.531584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:10.532092 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:10.538051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.539691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.540763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.541215 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.555940 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:10.564962 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:10.566630 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:10.566779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:58:10.568041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-eea81c88-e9c0-488e-97df-7846185ec9f6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1715 microversion: 2.20 time: 0.273276 Jul 29 04:58:10.568710 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 529/1046] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 04:58:10 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1715 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 04:58:10.618116 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:10.658222 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a2f4a5f6-a8f2-41cf-a267-fa70e33eecaa tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 204 len: 0 microversion: 2.1 time: 0.130080 Jul 29 04:58:10.659071 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 518/1047] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:58:10 2022] DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 04:58:10.671474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:10.672309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:10.678596 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.679565 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.680348 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.680884 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.925512 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:10.925694 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-0c2d2319-9512-4960-a9f7-958e38598257 req-94e22aba-c1b8-4b21-9efc-06114bcada1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27c1c2c-a7fb-4552-9ef0-9acafa894a99", "name": "network-vif-deleted", "tag": "ac1f13bc-ec87-4b3e-b528-f2300635c000"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:10.938456 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e4896a36-f7ae-4507-9ec6-0f798fa2ac3e tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1672 microversion: 2.1 time: 0.270685 Jul 29 04:58:10.939542 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 530/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:10 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1672 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:10.941143 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-0c2d2319-9512-4960-a9f7-958e38598257 req-94e22aba-c1b8-4b21-9efc-06114bcada1f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:10.941967 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-0c2d2319-9512-4960-a9f7-958e38598257 req-94e22aba-c1b8-4b21-9efc-06114bcada1f service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:10.961899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-0c2d2319-9512-4960-a9f7-958e38598257 req-94e22aba-c1b8-4b21-9efc-06114bcada1f service nova] Creating event network-vif-deleted:ac1f13bc-ec87-4b3e-b528-f2300635c000 for instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 on hv-cinder-85144 Jul 29 04:58:10.968627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-0c2d2319-9512-4960-a9f7-958e38598257 req-94e22aba-c1b8-4b21-9efc-06114bcada1f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049439 Jul 29 04:58:10.969236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 519/1049] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:58:11.296284 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:11.296925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:11.303426 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:11.304402 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:11.305396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:11.305843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:11.368043 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:11.375617 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-40082678-84c9-4d48-bda5-9543b0752ed6 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1473 microversion: 2.1 time: 0.083256 Jul 29 04:58:11.376191 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 531/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:11 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1473 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:11.977294 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:11.977905 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:11.984480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:11.984974 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:11.985715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:11.986150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:12.117521 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:12.125171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8a1655b3-e19d-44c9-bdd9-b1f08d09571a tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1672 microversion: 2.1 time: 0.152782 Jul 29 04:58:12.125739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 520/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:11 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:58:12.396257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:12.396901 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:12.403580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:12.404028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:12.404821 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:12.405258 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:12.436873 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:12.437321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:12.437772 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lazy-loading 'fault' on Instance uuid e27c1c2c-a7fb-4552-9ef0-9acafa894a99 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:12.478267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:12.485856 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-efce3edf-682f-4803-9ac8-5b74881b33c5 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 200 len: 1309 microversion: 2.1 time: 0.093484 Jul 29 04:58:12.486359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 532/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:12 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:13.146795 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:13.147517 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:13.154383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:13.154909 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:13.155772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:13.156281 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:13.293508 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:13.300996 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ef099ee3-2690-4871-a886-4faee0e27858 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1672 microversion: 2.1 time: 0.158093 Jul 29 04:58:13.301567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 521/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:13 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:13.508740 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:13.509987 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: e27c1c2c-a7fb-4552-9ef0-9acafa894a99] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:13.516823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:13.517294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:13.518122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:13.518571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:13.533921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] HTTP exception thrown: Instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 could not be found. Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Request method failure captured: Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 HTTP/1.1 Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42iSUX-tN_vhwoJ9VuMxdb9Dm02LP46oyWxyJN8JcaE9m_QCKB3xhzqqqA8j3ZBDbYjccv6jJYpLE4yy3kTFBteQK5NaQQbaEkm3hW8_O1yQ3E1XImkCZDstLBgf8sKJwrBARz-aBpVLNFgcnB8WBIMJm2H6uS8r0nuWjNW0RdB8XX4 Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 62319662d8e34fc8bbe01e0410cec30a Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1556868348 Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:58:13.535626 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesSnapshotTestJSON-1556868348 Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 62319662d8e34fc8bbe01e0410cec30a Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1556868348 Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesSnapshotTestJSON-1556868348-project Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 7136bb1746744ce89f74c1185c76d043 Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesSnapshotTestJSON-1556868348-project Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 could not be found. Jul 29 04:58:13.537274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': 'e27c1c2c-a7fb-4552-9ef0-9acafa894a99'} Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 could not be found. Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:58:13.538174 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 could not be found. Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 could not be found. Jul 29 04:58:13.545111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:13.546752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Returning 404 to user: Instance e27c1c2c-a7fb-4552-9ef0-9acafa894a99 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:58:13.546752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f894b54b-444e-4c2e-98b2-24d68147987d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99" status: 404 len: 111 microversion: 2.1 time: 0.033636 Jul 29 04:58:13.546752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 533/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:13 2022] GET /compute/v2.1/servers/e27c1c2c-a7fb-4552-9ef0-9acafa894a99 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:58:13.794309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-a5462c5c-9c74-40eb-aaf0-2f17d559e91c req-84d96d68-7d68-470e-a899-0a9ec0de0e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f419f4-d879-49b1-b580-9bfbd7a1f5a8", "name": "network-vif-deleted", "tag": "2548b355-cc75-4f48-aa15-872f7943167a"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:13.805781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-a5462c5c-9c74-40eb-aaf0-2f17d559e91c req-84d96d68-7d68-470e-a899-0a9ec0de0e8e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:13.806327 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-a5462c5c-9c74-40eb-aaf0-2f17d559e91c req-84d96d68-7d68-470e-a899-0a9ec0de0e8e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:13.818424 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-a5462c5c-9c74-40eb-aaf0-2f17d559e91c req-84d96d68-7d68-470e-a899-0a9ec0de0e8e service nova] Creating event network-vif-deleted:2548b355-cc75-4f48-aa15-872f7943167a for instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 on hv-cinder-85144 Jul 29 04:58:13.824990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-a5462c5c-9c74-40eb-aaf0-2f17d559e91c req-84d96d68-7d68-470e-a899-0a9ec0de0e8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034346 Jul 29 04:58:13.825985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 522/1055] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:14.323149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:14.323769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:14.329780 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:14.330240 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:14.331018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:14.331465 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:14.363556 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:14.363923 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:14.364376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'fault' on Instance uuid a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:14.405769 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:14.414148 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3b0a6dbf-4dac-44bc-9a2d-f7d5704ce038 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1326 microversion: 2.1 time: 0.094542 Jul 29 04:58:14.415161 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 534/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:14 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:15.437269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:15.438001 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:15.444148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:15.445198 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:15.445964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:15.446404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:15.476080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:15.476523 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:15.477005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'fault' on Instance uuid a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:15.518263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:15.525595 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c3599c35-be0f-4c8e-8692-c8ec7167a5d0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1326 microversion: 2.1 time: 0.093151 Jul 29 04:58:15.526158 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 523/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:15 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:16.546566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:16.547176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:16.554029 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:16.554724 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:16.555550 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:16.555988 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:16.587892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:16.588330 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:16.588804 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'fault' on Instance uuid a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:16.633784 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:16.641137 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8421bc48-2b94-4471-a043-c77aebfd9726 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1326 microversion: 2.1 time: 0.098614 Jul 29 04:58:16.641697 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 535/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:16 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:17.662437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:17.663065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:17.670523 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:17.670982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:17.671760 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:17.672202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:17.702919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:17.703375 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:17.703827 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lazy-loading 'fault' on Instance uuid a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:17.745466 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b7751b93f88424abebe6859f46f8351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946bf1e173f9476d86cf6133055fba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:17.752928 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-dade0df8-cc24-485b-84dc-977760a143f0 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 200 len: 1326 microversion: 2.1 time: 0.094465 Jul 29 04:58:17.753502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 524/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:17 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:18.773616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:18.774267 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:18.780893 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:18.781359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:18.782129 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:18.782573 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:18.796335 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] HTTP exception thrown: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Request method failure captured: Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 HTTP/1.1 Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42Ziig0WPSjAVlfNVqxEyk0O0ZjyzCua6ZMMGTCb0AYobw6b9XATg-YQXsldKayQDamqssKZPjSSOW6USgKvn0JsfAV8zwGdgF7ghj1tsmpiiM6H6E_DjhPRGFTIE25uzpO6K6k0mT2w6Nq-T-QdvRhcFRKPRyj7uyoxjAkFdNvwAO0 Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:58:18.797892 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 8b7751b93f88424abebe6859f46f8351 Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:18.799487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': 'a4f419f4-d879-49b1-b580-9bfbd7a1f5a8'} Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:58:18.800391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:18.801950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:58:18.803346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Returning 404 to user: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:58:18.803346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-daf05f28-8bda-4544-8490-f74322827a09 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 404 len: 111 microversion: 2.1 time: 0.029969 Jul 29 04:58:18.803346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 536/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:18 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:58:18.808865 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-58f334d2-2a96-4208-9ca8-64e37939622c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '.version_select at 0x7f3c54369040>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:18.827430 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-58f334d2-2a96-4208-9ca8-64e37939622c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468706397" status: 202 len: 0 microversion: 2.1 time: 0.022418 Jul 29 04:58:18.827992 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 525/1061] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Jul 29 04:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468706397 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:58:24.436014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1446810743", "imageRef": "214bdccd-59be-4b50-a7e6-566094e0233e", "flavorRef": "452", "networks": [{"uuid": "f6122d12-dacd-40c0-a20f-9d53ca795a2c"}]}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:24.444587 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=48 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:24.490422 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] validate_networks() for [('f6122d12-dacd-40c0-a20f-9d53ca795a2c', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 04:58:24.847578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 04:58:24.848004 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 04:58:24.848515 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 04:58:24.848956 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 04:58:24.849368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 04:58:24.860636 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:24.861084 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:24.861942 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:24.862337 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:24.879595 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:24.880133 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:24.880550 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Getting quotas for project 62319662d8e34fc8bbe01e0410cec30a. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 04:58:24.882561 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:24.885672 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Getting quotas for user 7136bb1746744ce89f74c1185c76d043 and project 62319662d8e34fc8bbe01e0410cec30a. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 04:58:24.887994 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:24.888447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:24.889301 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:24.889748 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:24.897234 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 04:58:24.900216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214bdccd-59be-4b50-a7e6-566094e0233e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 04:58:24.905610 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] HTTP exception thrown: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Request method failure captured: Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 HTTP/1.1 Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42Ziig0WPSjAVlfNVqxEyk0O0ZjyzCua6ZMMGTCb0AYobw6b9XATg-YQXsldKayQDamqssKZPjSSOW6USgKvn0JsfAV8zwGdgF7ghj1tsmpiiM6H6E_DjhPRGFTIE25uzpO6K6k0mT2w6Nq-T-QdvRhcFRKPRyj7uyoxjAkFdNvwAO0 Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:58:24.907302 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 8b7751b93f88424abebe6859f46f8351 Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.909040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': 'a4f419f4-d879-49b1-b580-9bfbd7a1f5a8'} Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:58:24.909880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.911221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.912489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Returning 404 to user: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:58:24.912489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a955d02b-a1ba-4a25-a6fb-1912180cc814 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 404 len: 111 microversion: 2.1 time: 0.033756 Jul 29 04:58:24.912489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 526/1062] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:58:24 2022] DELETE /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:58:24.917581 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:24.918189 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: a4f419f4-d879-49b1-b580-9bfbd7a1f5a8] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:24.924103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:24.924564 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:24.925378 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:24.925822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:24.939584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] HTTP exception thrown: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Request method failure captured: Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 HTTP/1.1 Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42Ziig0WPSjAVlfNVqxEyk0O0ZjyzCua6ZMMGTCb0AYobw6b9XATg-YQXsldKayQDamqssKZPjSSOW6USgKvn0JsfAV8zwGdgF7ghj1tsmpiiM6H6E_DjhPRGFTIE25uzpO6K6k0mT2w6Nq-T-QdvRhcFRKPRyj7uyoxjAkFdNvwAO0 Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:58:24.941147 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 8b7751b93f88424abebe6859f46f8351 Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.942802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': 'a4f419f4-d879-49b1-b580-9bfbd7a1f5a8'} Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:58:24.945829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. Jul 29 04:58:24.947325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:24.948584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Returning 404 to user: Instance a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:58:24.948584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d3d85a93-2635-4ee8-8999-efa098f3011c tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8" status: 404 len: 111 microversion: 2.1 time: 0.029174 Jul 29 04:58:24.948584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 527/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:24 2022] GET /compute/v2.1/servers/a4f419f4-d879-49b1-b580-9bfbd7a1f5a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:58:24.948865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-762f9c72-e690-41ec-bae8-73b15fba250b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515339 Jul 29 04:58:24.948865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 537/1064] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 04:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 04:58:24.958852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d2797e5e-8835-4219-a670-4789e178892e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:24.959547 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d2797e5e-8835-4219-a670-4789e178892e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:25.019453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d2797e5e-8835-4219-a670-4789e178892e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:25.026573 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d2797e5e-8835-4219-a670-4789e178892e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1219 microversion: 2.1 time: 0.071552 Jul 29 04:58:25.027133 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 528/1065] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:24 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:26.047926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:26.048531 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:26.055276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:26.055723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:26.056477 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:26.057074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:26.100680 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:26.102040 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:26.109148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:26.109599 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:26.110372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:26.110804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:26.124183 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:26.125012 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] HTTP exception thrown: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Request method failure captured: Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: DELETE /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e HTTP/1.1 Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42Ziig0WPSjAVlfNVqxEyk0O0ZjyzCua6ZMMGTCb0AYobw6b9XATg-YQXsldKayQDamqssKZPjSSOW6USgKvn0JsfAV8zwGdgF7ghj1tsmpiiM6H6E_DjhPRGFTIE25uzpO6K6k0mT2w6Nq-T-QdvRhcFRKPRyj7uyoxjAkFdNvwAO0 Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:58:26.126565 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 8b7751b93f88424abebe6859f46f8351 Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.128145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '32c9906c-fdab-4215-a1c5-5cb82c3ab79e'} Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:58:26.129005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.130630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.133046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Returning 404 to user: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:58:26.133046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6308af68-e365-48f3-8e2d-b9475e448895 tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 404 len: 111 microversion: 2.1 time: 0.031267 Jul 29 04:58:26.133046 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 529/1066] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:58:26 2022] DELETE /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:58:26.137075 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-54cc9913-31c4-4fcb-92d6-7e76b38a61ad tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1271 microversion: 2.1 time: 0.093395 Jul 29 04:58:26.137415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:26.138407 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 538/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:26 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:26.138541 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] [instance: 32c9906c-fdab-4215-a1c5-5cb82c3ab79e] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:26.144831 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:26.145285 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:26.146047 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:26.146480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:26.161842 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] HTTP exception thrown: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Request method failure captured: Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e HTTP/1.1 Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42Ziig0WPSjAVlfNVqxEyk0O0ZjyzCua6ZMMGTCb0AYobw6b9XATg-YQXsldKayQDamqssKZPjSSOW6USgKvn0JsfAV8zwGdgF7ghj1tsmpiiM6H6E_DjhPRGFTIE25uzpO6K6k0mT2w6Nq-T-QdvRhcFRKPRyj7uyoxjAkFdNvwAO0 Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:58:26.163428 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/946bf1e173f9476d86cf6133055fba0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 946bf1e173f9476d86cf6133055fba0a Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeTestJSON-75429202 Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 8b7751b93f88424abebe6859f46f8351 Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeTestJSON-75429202-project Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.165082 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '32c9906c-fdab-4215-a1c5-5cb82c3ab79e'} Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:58:26.166219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. Jul 29 04:58:26.167643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:58:26.168941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] Returning 404 to user: Instance 32c9906c-fdab-4215-a1c5-5cb82c3ab79e could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:58:26.168941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f466d3d2-dc48-4332-bd31-0b8faf818add tempest-AttachVolumeTestJSON-75429202 tempest-AttachVolumeTestJSON-75429202-project] 10.222.0.40 "GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e" status: 404 len: 111 microversion: 2.1 time: 0.031267 Jul 29 04:58:26.168941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 530/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:26 2022] GET /compute/v2.1/servers/32c9906c-fdab-4215-a1c5-5cb82c3ab79e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:58:27.158168 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:27.158819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:27.166116 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:27.166573 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:27.167355 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:27.167802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:27.254309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:27.263776 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8d6ef54b-ceaf-49e4-874b-4d552f873c25 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1277 microversion: 2.1 time: 0.108949 Jul 29 04:58:27.264051 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 539/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:27 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:28.287593 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:28.288950 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:28.296617 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:28.297093 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:28.297883 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:28.298360 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:28.434735 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:28.442480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a9d3f121-e07b-42cb-bc6f-fc12e9d06df7 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.158948 Jul 29 04:58:28.455474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 531/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:28 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:29.463983 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:29.464772 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:29.471228 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:29.471683 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:29.472460 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:29.472938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:29.688309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:29.699684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8c879a7b-0b74-43df-95e1-c0a218fe26e8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.240263 Jul 29 04:58:29.713283 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 540/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:29 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:29.735717 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-e512821d-ac66-46d1-884c-a5762aad0620 req-c744290f-5523-4ea7-ab3f-90f5e0389d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c39d4c-13bb-4334-8bab-824a0bb63870", "tag": "424252b7-0423-412c-a37a-881037fb6cbc"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:29.748290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-e512821d-ac66-46d1-884c-a5762aad0620 req-c744290f-5523-4ea7-ab3f-90f5e0389d89 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:29.748768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-e512821d-ac66-46d1-884c-a5762aad0620 req-c744290f-5523-4ea7-ab3f-90f5e0389d89 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:29.767323 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-e512821d-ac66-46d1-884c-a5762aad0620 req-c744290f-5523-4ea7-ab3f-90f5e0389d89 service nova] Creating event network-changed:424252b7-0423-412c-a37a-881037fb6cbc for instance b8c39d4c-13bb-4334-8bab-824a0bb63870 on hv-cinder-85144 Jul 29 04:58:29.773551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-e512821d-ac66-46d1-884c-a5762aad0620 req-c744290f-5523-4ea7-ab3f-90f5e0389d89 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040355 Jul 29 04:58:29.777370 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 532/1072] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:30.722374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:30.723252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:30.730732 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:30.731420 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:30.732201 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:30.732699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:30.873025 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:30.880573 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a0c69224-f8d7-4205-b2dc-5183539a6cf2 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.162467 Jul 29 04:58:30.881168 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 541/1073] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:30 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:31.905312 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:31.906204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:31.913220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:31.913886 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:31.914739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:31.915242 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:32.055307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:32.063001 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-62bc58f7-2ba0-4b97-bf51-93cbe0d5038b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.164849 Jul 29 04:58:32.063582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 533/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:31 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:33.085248 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:33.085925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:33.093329 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:33.093791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:33.094572 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:33.095080 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:33.235335 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:33.243185 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-797a02eb-25d3-451e-9c32-d225ed6806ed tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.161819 Jul 29 04:58:33.243761 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 542/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:33 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:34.263353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:34.263971 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:34.270664 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:34.271117 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:34.271887 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:34.272331 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:34.400042 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:34.407524 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-def39385-c145-4a14-b3bf-faea6707eab8 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.148060 Jul 29 04:58:34.408084 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 534/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:34 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:35.433022 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:35.433632 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:35.435891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:35.436545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:35.442586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:35.443036 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:35.443889 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:35.444840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:35.581613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:35.589751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f6cefbc7-ddb8-4b3f-a74f-c9ad4511a7dc tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.160728 Jul 29 04:58:35.590323 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 543/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:35 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:36.193120 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:36.350203 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-139ac799-619f-464b-9453-472e0a302d2d req-c4cf2588-9e80-4b97-af03-3f5938aad08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c39d4c-13bb-4334-8bab-824a0bb63870", "name": "network-vif-plugged", "status": "completed", "tag": "424252b7-0423-412c-a37a-881037fb6cbc"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:36.361552 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-139ac799-619f-464b-9453-472e0a302d2d req-c4cf2588-9e80-4b97-af03-3f5938aad08c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:36.362188 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-139ac799-619f-464b-9453-472e0a302d2d req-c4cf2588-9e80-4b97-af03-3f5938aad08c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:36.376535 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-139ac799-619f-464b-9453-472e0a302d2d req-c4cf2588-9e80-4b97-af03-3f5938aad08c service nova] Creating event network-vif-plugged:424252b7-0423-412c-a37a-881037fb6cbc for instance b8c39d4c-13bb-4334-8bab-824a0bb63870 on hv-cinder-85144 Jul 29 04:58:36.381789 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-139ac799-619f-464b-9453-472e0a302d2d req-c4cf2588-9e80-4b97-af03-3f5938aad08c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193097 Jul 29 04:58:36.382935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 535/1078] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:36.611570 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:36.612301 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:36.619957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:36.620547 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:36.621456 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:36.622042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:36.756224 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:36.758928 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=100 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:36.765588 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-120556b5-7118-4594-95c4-e354f8d66ffd tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.158131 Jul 29 04:58:36.766176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 544/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:36 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:37.788701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:37.789468 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:37.795866 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:37.796325 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:37.797132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:37.797580 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:37.934184 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:37.941764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4fca65ab-2e1d-4e42-b557-c6190d222ea9 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1319 microversion: 2.1 time: 0.157984 Jul 29 04:58:37.942411 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 536/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:37 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:38.418292 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6eb5a89c-8927-401f-a47f-6a13163cb594 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:38.421102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6eb5a89c-8927-401f-a47f-6a13163cb594 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:38.427898 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eb5a89c-8927-401f-a47f-6a13163cb594 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:38.428360 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eb5a89c-8927-401f-a47f-6a13163cb594 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:38.429770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eb5a89c-8927-401f-a47f-6a13163cb594 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:38.430221 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6eb5a89c-8927-401f-a47f-6a13163cb594 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:38.453904 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6eb5a89c-8927-401f-a47f-6a13163cb594 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/ips" status: 200 len: 150 microversion: 2.1 time: 0.040389 Jul 29 04:58:38.454495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 545/1081] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 04:58:38 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:38.963740 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:38.964354 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:38.971228 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:38.971700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:38.972457 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:38.972929 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:39.122790 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:58:39.130500 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-702f5036-780b-4f4e-8ec7-3cbe3ea9dc6b tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1508 microversion: 2.1 time: 0.171226 Jul 29 04:58:39.131057 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 537/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:58:38 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:58:39.160842 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-504b993a-fc55-41d5-8fed-3b72f299240a tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "040f60ad-4674-4ab5-8425-d0179c6d702a", "device": "/dev/sdb"}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:39.163974 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-504b993a-fc55-41d5-8fed-3b72f299240a tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:39.170472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-504b993a-fc55-41d5-8fed-3b72f299240a tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:39.170930 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-504b993a-fc55-41d5-8fed-3b72f299240a tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:39.171709 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-504b993a-fc55-41d5-8fed-3b72f299240a tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:39.172159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-504b993a-fc55-41d5-8fed-3b72f299240a tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:39.466235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-504b993a-fc55-41d5-8fed-3b72f299240a tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "POST /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309284 Jul 29 04:58:39.466966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 546/1083] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:58:39 2022] POST /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:39.808329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d3e4be11-eeaa-4b86-a487-5186f8d3f42f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f08d510-cd75-4091-a20d-111eff30ba4c"}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:58:39.810862 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d3e4be11-eeaa-4b86-a487-5186f8d3f42f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:39.817021 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3e4be11-eeaa-4b86-a487-5186f8d3f42f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:39.817480 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3e4be11-eeaa-4b86-a487-5186f8d3f42f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:39.818275 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3e4be11-eeaa-4b86-a487-5186f8d3f42f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:39.818831 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d3e4be11-eeaa-4b86-a487-5186f8d3f42f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:40.096695 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d3e4be11-eeaa-4b86-a487-5186f8d3f42f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "POST /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293548 Jul 29 04:58:40.097306 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 538/1084] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Jul 29 04:58:39 2022] POST /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:57.390742 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:57.391459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:57.394326 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:57.395144 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:57.400953 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:57.401308 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:57.402386 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:57.402966 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:57.498413 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lazy-loading 'services' on Instance uuid 3e85f641-7d4e-4121-933b-e00793f410b0 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:58:57.571600 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-95383fd5-b282-4688-9398-b82cd47cd43e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments/3f08d510-cd75-4091-a20d-111eff30ba4c" status: 202 len: 0 microversion: 2.1 time: 0.185210 Jul 29 04:58:57.572242 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 547/1085] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:58:57 2022] DELETE /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments/3f08d510-cd75-4091-a20d-111eff30ba4c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:58:57.578944 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=27 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:57.579829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 04:58:57.584278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ec6203e6-f62d-4427-b70f-288cf3f812fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:57.587303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ec6203e6-f62d-4427-b70f-288cf3f812fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:57.595326 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec6203e6-f62d-4427-b70f-288cf3f812fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:57.595795 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec6203e6-f62d-4427-b70f-288cf3f812fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:57.596580 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec6203e6-f62d-4427-b70f-288cf3f812fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:57.597149 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec6203e6-f62d-4427-b70f-288cf3f812fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:57.628831 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ec6203e6-f62d-4427-b70f-288cf3f812fd tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051153 Jul 29 04:58:57.632880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 539/1086] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:58:57 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:58.642140 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-381e82aa-c4aa-45de-b480-ac833123a656 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:58.644517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-381e82aa-c4aa-45de-b480-ac833123a656 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:58.652429 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e82aa-c4aa-45de-b480-ac833123a656 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:58.652925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e82aa-c4aa-45de-b480-ac833123a656 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:58.653715 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e82aa-c4aa-45de-b480-ac833123a656 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:58.654166 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e82aa-c4aa-45de-b480-ac833123a656 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:58.685043 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-381e82aa-c4aa-45de-b480-ac833123a656 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047178 Jul 29 04:58:58.685641 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 548/1087] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:58:58 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:58:59.697253 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-22307a42-96b7-4757-9b55-6a554acb14a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:58:59.699441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-22307a42-96b7-4757-9b55-6a554acb14a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:58:59.705904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22307a42-96b7-4757-9b55-6a554acb14a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:59.706364 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22307a42-96b7-4757-9b55-6a554acb14a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:59.707135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22307a42-96b7-4757-9b55-6a554acb14a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:58:59.707579 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-22307a42-96b7-4757-9b55-6a554acb14a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:58:59.737320 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-22307a42-96b7-4757-9b55-6a554acb14a0 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Jul 29 04:58:59.737857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 540/1088] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:58:59 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:59:00.749402 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-1c111706-6105-46e8-8dad-9eaca77becd2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:00.751571 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-1c111706-6105-46e8-8dad-9eaca77becd2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:00.758755 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c111706-6105-46e8-8dad-9eaca77becd2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:00.759208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c111706-6105-46e8-8dad-9eaca77becd2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:00.759978 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c111706-6105-46e8-8dad-9eaca77becd2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:00.760419 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-1c111706-6105-46e8-8dad-9eaca77becd2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:00.788467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-1c111706-6105-46e8-8dad-9eaca77becd2 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043032 Jul 29 04:59:00.789633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 549/1089] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:59:00 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:59:01.800950 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d2616b5d-667b-4f10-8b88-7b1d1729517f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:01.806094 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d2616b5d-667b-4f10-8b88-7b1d1729517f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:01.813053 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d2616b5d-667b-4f10-8b88-7b1d1729517f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:01.813286 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d2616b5d-667b-4f10-8b88-7b1d1729517f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:01.814065 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d2616b5d-667b-4f10-8b88-7b1d1729517f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:01.814505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d2616b5d-667b-4f10-8b88-7b1d1729517f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:01.844931 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d2616b5d-667b-4f10-8b88-7b1d1729517f tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047931 Jul 29 04:59:01.845485 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 541/1090] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:59:01 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:59:02.860810 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3c125ec5-7662-4ac7-ab27-ab2eb5c012e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:02.861578 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3c125ec5-7662-4ac7-ab27-ab2eb5c012e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:02.867782 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c125ec5-7662-4ac7-ab27-ab2eb5c012e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:02.868243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c125ec5-7662-4ac7-ab27-ab2eb5c012e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:02.869045 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c125ec5-7662-4ac7-ab27-ab2eb5c012e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:02.869490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c125ec5-7662-4ac7-ab27-ab2eb5c012e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:02.900551 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3c125ec5-7662-4ac7-ab27-ab2eb5c012e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046149 Jul 29 04:59:02.901165 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 550/1091] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Jul 29 04:59:02 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 04:59:02.977504 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:02.977504 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:02.984002 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:02.984522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:02.985388 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:02.985896 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:03.011719 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:59:03.091808 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-6db07858-d1a3-4606-a7f5-71bb1bfcd373 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 204 len: 0 microversion: 2.1 time: 0.121095 Jul 29 04:59:03.092475 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 542/1092] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:59:02 2022] DELETE /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:59:03.100848 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:03.101150 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:03.107944 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:03.108400 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:03.109193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:03.109677 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:03.250162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:03.258442 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ca53a81a-8cdc-4ca5-a0bf-af7e03bd25ce tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1680 microversion: 2.1 time: 0.161613 Jul 29 04:59:03.259097 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 551/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:03 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:59:04.279822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:04.280437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:04.286822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:04.287269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:04.288056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:04.288490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:04.421207 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:04.429448 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-29ce06bf-6749-407e-9aee-81989c1bc1e3 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1680 microversion: 2.1 time: 0.153868 Jul 29 04:59:04.430562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 543/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:04 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:59:05.108812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:05.109454 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:05.115673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:05.116124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:05.116934 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:05.118493 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:05.213635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lazy-loading 'services' on Instance uuid b8c39d4c-13bb-4334-8bab-824a0bb63870 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:59:05.290912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-ac1ddf30-ffde-4c92-bb65-42f8a6761158 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870/os-volume_attachments/040f60ad-4674-4ab5-8425-d0179c6d702a" status: 202 len: 0 microversion: 2.1 time: 0.185532 Jul 29 04:59:05.292555 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 552/1095] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Jul 29 04:59:05 2022] DELETE /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870/os-volume_attachments/040f60ad-4674-4ab5-8425-d0179c6d702a => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:59:05.452126 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:05.454483 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:05.464003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:05.464451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:05.466109 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:05.466858 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:05.620589 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:05.629088 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-eb2511de-e9e0-4f9d-8350-e517a0876700 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1680 microversion: 2.1 time: 0.181125 Jul 29 04:59:05.630181 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 544/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:05 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:59:06.354382 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-fe9c8308-c627-4f70-867d-610ff0167c47 req-707bada5-ae84-4283-931e-eb8e8dbb2227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e85f641-7d4e-4121-933b-e00793f410b0", "name": "network-vif-deleted", "tag": "16945bc9-3458-44e2-a493-5680610d8654"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:59:06.374952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-fe9c8308-c627-4f70-867d-610ff0167c47 req-707bada5-ae84-4283-931e-eb8e8dbb2227 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.376081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-fe9c8308-c627-4f70-867d-610ff0167c47 req-707bada5-ae84-4283-931e-eb8e8dbb2227 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.389863 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-fe9c8308-c627-4f70-867d-610ff0167c47 req-707bada5-ae84-4283-931e-eb8e8dbb2227 service nova] Creating event network-vif-deleted:16945bc9-3458-44e2-a493-5680610d8654 for instance 3e85f641-7d4e-4121-933b-e00793f410b0 on hv-cinder-85144 Jul 29 04:59:06.394959 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-fe9c8308-c627-4f70-867d-610ff0167c47 req-707bada5-ae84-4283-931e-eb8e8dbb2227 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276416 Jul 29 04:59:06.396247 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 553/1097] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 04:59:06.452912 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:06.454346 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:06.462115 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.462835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.463843 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.464490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.495191 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 04:59:06.607784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-57874065-9931-4a4e-913a-5c6310026535 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 204 len: 0 microversion: 2.1 time: 0.158836 Jul 29 04:59:06.608423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 545/1098] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:59:06 2022] DELETE /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 04:59:06.618460 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:06.619367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:06.629038 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.629666 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.630633 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.631256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.660696 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:06.661421 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:06.673759 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.674236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.675039 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.675486 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.724502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:06.725035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:06.725502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lazy-loading 'fault' on Instance uuid 3e85f641-7d4e-4121-933b-e00793f410b0 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:59:06.772318 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:06.782213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-eae6d88a-30be-4c9d-948a-2e8491621dfe tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1330 microversion: 2.1 time: 0.130497 Jul 29 04:59:06.783587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 546/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:06 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:59:06.796082 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:06.804866 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-480950e9-ceda-4c7c-8649-5886a3fda59d tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1514 microversion: 2.1 time: 0.191648 Jul 29 04:59:06.805426 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 554/1100] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:06 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:59:07.805939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:07.806548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:07.813933 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:07.814392 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:07.815201 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:07.815653 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:07.825850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:07.826491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:07.833064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:07.833516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:07.834278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:07.834717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:07.848153 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:07.848839 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:07.849438 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.objects.instance [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lazy-loading 'fault' on Instance uuid 3e85f641-7d4e-4121-933b-e00793f410b0 {{(pid=129683) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 04:59:07.892516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572408fd157844dcae13000d8e9c4b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461e2af738084ccb986169d752510588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:07.901496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-79995985-7290-41b5-9905-ea1e0e14e8c1 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 200 len: 1330 microversion: 2.1 time: 0.099608 Jul 29 04:59:07.902089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 547/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:07 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 04:59:07.973812 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:07.981499 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f053ab67-bab0-4544-b56e-e72e98f6b199 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1514 microversion: 2.1 time: 0.159484 Jul 29 04:59:07.982065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 555/1102] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:07 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:59:08.927314 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:08.928226 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:08.936039 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:08.936522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:08.937337 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:08.937782 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:08.952259 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 HTTP/1.1 Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:59:08.954441 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:08.955913 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '3e85f641-7d4e-4121-933b-e00793f410b0'} Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:08.960578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:08.962687 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:08.964080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:08.964080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-586c7dcd-bef0-4daa-aaab-e13df97d7363 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 404 len: 111 microversion: 2.1 time: 0.036054 Jul 29 04:59:08.964080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 548/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:08 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:59:08.970122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5ceb4725-91fd-4a4a-bfe8-be4b3f117f8e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '.version_select at 0x7f3c5439dca0>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:08.974217 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ceb4725-91fd-4a4a-bfe8-be4b3f117f8e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [ece5ca08-4047-4ae8-9966-a11f08e5d1e2] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 04:59:09.003531 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:09.004146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:09.011287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:09.011744 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:09.012516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:09.012990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:09.150176 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136bb1746744ce89f74c1185c76d043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62319662d8e34fc8bbe01e0410cec30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 04:59:09.157928 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-aefd94c4-f8b6-4e44-b2bb-1dcca0acec30 tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 200 len: 1514 microversion: 2.1 time: 0.158338 Jul 29 04:59:09.158641 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 549/1104] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:08 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 04:59:09.315560 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-7294e156-2fd3-4e27-8d07-efecad1ddc8c req-a7d6229f-c7df-4300-9341-21494299d7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c39d4c-13bb-4334-8bab-824a0bb63870", "name": "network-vif-deleted", "tag": "424252b7-0423-412c-a37a-881037fb6cbc"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 04:59:09.326308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-7294e156-2fd3-4e27-8d07-efecad1ddc8c req-a7d6229f-c7df-4300-9341-21494299d7ae service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:09.326943 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-7294e156-2fd3-4e27-8d07-efecad1ddc8c req-a7d6229f-c7df-4300-9341-21494299d7ae service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:09.342038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-7294e156-2fd3-4e27-8d07-efecad1ddc8c req-a7d6229f-c7df-4300-9341-21494299d7ae service nova] Creating event network-vif-deleted:424252b7-0423-412c-a37a-881037fb6cbc for instance b8c39d4c-13bb-4334-8bab-824a0bb63870 on hv-cinder-85144 Jul 29 04:59:09.346813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-7294e156-2fd3-4e27-8d07-efecad1ddc8c req-a7d6229f-c7df-4300-9341-21494299d7ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034994 Jul 29 04:59:09.347600 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 550/1105] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 04:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 04:59:09.981686 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ceb4725-91fd-4a4a-bfe8-be4b3f117f8e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [ece5ca08-4047-4ae8-9966-a11f08e5d1e2] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 51702. Jul 29 04:59:10.000379 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5ceb4725-91fd-4a4a-bfe8-be4b3f117f8e tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575968359" status: 202 len: 0 microversion: 2.1 time: 1.034558 Jul 29 04:59:10.001005 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 556/1106] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Jul 29 04:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575968359 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 04:59:10.183956 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:10.184553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] [instance: b8c39d4c-13bb-4334-8bab-824a0bb63870] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:10.192068 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:10.192546 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:10.193349 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:10.193783 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:10.209871 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] HTTP exception thrown: Instance b8c39d4c-13bb-4334-8bab-824a0bb63870 could not be found. Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Request method failure captured: Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 HTTP/1.1 Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42iSUX-tN_vhwoJ9VuMxdb9Dm02LP46oyWxyJN8JcaE9m_QCKB3xhzqqqA8j3ZBDbYjccv6jJYpLE4yy3kTFBteQK5NaQQbaEkm3hW8_O1yQ3E1XImkCZDstLBgf8sKJwrBARz-aBpVLNFgcnB8WBIMJm2H6uS8r0nuWjNW0RdB8XX4 Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 62319662d8e34fc8bbe01e0410cec30a Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1556868348 Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:59:10.212113 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62319662d8e34fc8bbe01e0410cec30a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-VolumesSnapshotTestJSON-1556868348 Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 62319662d8e34fc8bbe01e0410cec30a Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1556868348 Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-VolumesSnapshotTestJSON-1556868348-project Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 7136bb1746744ce89f74c1185c76d043 Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-VolumesSnapshotTestJSON-1556868348-project Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance b8c39d4c-13bb-4334-8bab-824a0bb63870 could not be found. Jul 29 04:59:10.213877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': 'b8c39d4c-13bb-4334-8bab-824a0bb63870'} Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c39d4c-13bb-4334-8bab-824a0bb63870 could not be found. Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:10.214920 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c39d4c-13bb-4334-8bab-824a0bb63870 could not be found. Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c39d4c-13bb-4334-8bab-824a0bb63870 could not be found. Jul 29 04:59:10.216413 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:10.217673 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] Returning 404 to user: Instance b8c39d4c-13bb-4334-8bab-824a0bb63870 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:10.217673 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b26f2b2d-2bdf-4c32-8492-bcec42c81e4e tempest-VolumesSnapshotTestJSON-1556868348 tempest-VolumesSnapshotTestJSON-1556868348-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870" status: 404 len: 111 microversion: 2.1 time: 0.035928 Jul 29 04:59:10.217842 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 551/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:10 2022] GET /compute/v2.1/servers/b8c39d4c-13bb-4334-8bab-824a0bb63870 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:59:11.790914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:11.791437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:11.798448 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:11.798909 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:11.799684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:11.800127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:11.814500 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 HTTP/1.1 Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:59:11.816196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.817992 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '3e85f641-7d4e-4121-933b-e00793f410b0'} Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:11.818852 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.820490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.822319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:11.822319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-88512413-8dcc-445e-b960-66b3dc41ce42 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 404 len: 111 microversion: 2.1 time: 0.032132 Jul 29 04:59:11.822319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 557/1108] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:59:11 2022] DELETE /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:59:11.826415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:11.827034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 3e85f641-7d4e-4121-933b-e00793f410b0] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:11.834134 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:11.834593 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:11.835372 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:11.835814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:11.854322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 HTTP/1.1 Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:59:11.855924 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.857582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '3e85f641-7d4e-4121-933b-e00793f410b0'} Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:11.861494 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. Jul 29 04:59:11.862990 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:11.864474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 3e85f641-7d4e-4121-933b-e00793f410b0 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:11.864474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b5c6b1a7-8ab6-4045-9b88-5546042b4777 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0" status: 404 len: 111 microversion: 2.1 time: 0.035063 Jul 29 04:59:11.864474 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 552/1109] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:11 2022] GET /compute/v2.1/servers/3e85f641-7d4e-4121-933b-e00793f410b0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:59:20.367331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:20.367850 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:20.374490 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.374938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.375691 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.376130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.389844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c HTTP/1.1 Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:59:20.391368 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.393064 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '88854861-a8db-44a2-839b-5e158363e71c'} Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:20.394135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.395661 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.397274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:20.397274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bce07f5d-5b4f-4a16-a3a9-5d59fcfd0932 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 404 len: 111 microversion: 2.1 time: 0.029338 Jul 29 04:59:20.397274 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 558/1110] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:59:20 2022] DELETE /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:59:20.402737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:20.403409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 88854861-a8db-44a2-839b-5e158363e71c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:20.410471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.410937 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.411986 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.412432 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.426540 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c HTTP/1.1 Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:59:20.428119 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.429872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '88854861-a8db-44a2-839b-5e158363e71c'} Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:20.431539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. Jul 29 04:59:20.433076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.434380 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 88854861-a8db-44a2-839b-5e158363e71c could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:20.434380 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4bdf6f5d-7127-4cc2-bc72-2c8119413645 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c" status: 404 len: 111 microversion: 2.1 time: 0.031265 Jul 29 04:59:20.434380 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 553/1111] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:20 2022] GET /compute/v2.1/servers/88854861-a8db-44a2-839b-5e158363e71c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:59:20.442622 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:20.443120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:20.449350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.449783 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.450543 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.450980 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.466334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 HTTP/1.1 Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:59:20.467855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.469537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '42dff02f-3754-41d5-85a6-d6e4e3a74922'} Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:20.470651 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.472196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.473855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:20.473855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f8eeabaf-8f6e-4f28-a6fd-c65109a37a70 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 404 len: 111 microversion: 2.1 time: 0.030508 Jul 29 04:59:20.473855 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 559/1112] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:59:20 2022] DELETE /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:59:20.478268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:20.478870 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 42dff02f-3754-41d5-85a6-d6e4e3a74922] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:20.485374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.485820 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.486580 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:20.487014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:20.500731 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 HTTP/1.1 Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:59:20.502237 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.503919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '42dff02f-3754-41d5-85a6-d6e4e3a74922'} Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:20.505037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. Jul 29 04:59:20.506554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:20.507987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 42dff02f-3754-41d5-85a6-d6e4e3a74922 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:20.507987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1fa59508-b5c7-4f10-a60e-8128fc27f5c6 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922" status: 404 len: 111 microversion: 2.1 time: 0.029754 Jul 29 04:59:20.507987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 554/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:20 2022] GET /compute/v2.1/servers/42dff02f-3754-41d5-85a6-d6e4e3a74922 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 04:59:22.695245 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:22.695718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:22.702673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:22.703118 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:22.703878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:22.704311 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:22.718903 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 HTTP/1.1 Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 04:59:22.720428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.722099 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '94d225e6-c457-47da-bb55-5620ad7f15e7'} Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:22.723016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.724487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.726273 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:22.726273 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-488a19ab-7c32-4ec1-8c94-8a55f9db004c tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "DELETE /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 404 len: 111 microversion: 2.1 time: 0.030455 Jul 29 04:59:22.726273 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 560/1114] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 04:59:22 2022] DELETE /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 04:59:22.730663 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 04:59:22.731280 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] [instance: 94d225e6-c457-47da-bb55-5620ad7f15e7] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 04:59:22.737408 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:22.737864 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:22.738630 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 04:59:22.739072 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 04:59:22.752816 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] HTTP exception thrown: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Request method failure captured: Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 HTTP/1.1 Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42ZnWXO-ejqbj3X-hYj8kwNAZFs1qeDFnIuf4u-yf1AJnmV0_kVk63YvssPXfuIWtn5pLOD5Kav4PnhXJo-naqKDnddvKNPZmIKg8LdaZG5G2EwNgXnT3XSvrPYuP_uatAt9-9yK0YDDA1h2wSRUC9BrvOjSsnHcLMm9b_heclcShOw Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 04:59:22.754336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_461e2af738084ccb986169d752510588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/461e2af738084ccb986169d752510588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/461e2af738084ccb986169d752510588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: 461e2af738084ccb986169d752510588 Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-625373578 Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 572408fd157844dcae13000d8e9c4b7a Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeNegativeTest-625373578-project Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.755939 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '94d225e6-c457-47da-bb55-5620ad7f15e7'} Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 04:59:22.756832 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. Jul 29 04:59:22.758089 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 04:59:22.759899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] Returning 404 to user: Instance 94d225e6-c457-47da-bb55-5620ad7f15e7 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 04:59:22.759899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-17480a7d-53e1-4155-b3db-c91285eaccb8 tempest-AttachVolumeNegativeTest-625373578 tempest-AttachVolumeNegativeTest-625373578-project] 10.222.0.40 "GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7" status: 404 len: 111 microversion: 2.1 time: 0.029211 Jul 29 04:59:22.759899 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 555/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 04:59:22 2022] GET /compute/v2.1/servers/94d225e6-c457-47da-bb55-5620ad7f15e7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:00:04.868305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-43cbbba3-02e9-4bb4-824c-e6768adc52fa tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:04.870503 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-43cbbba3-02e9-4bb4-824c-e6768adc52fa tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:04.873361 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:04.874014 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:04.879914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-43cbbba3-02e9-4bb4-824c-e6768adc52fa tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:04.880483 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-43cbbba3-02e9-4bb4-824c-e6768adc52fa tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:04.881350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-43cbbba3-02e9-4bb4-824c-e6768adc52fa tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:04.881888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-43cbbba3-02e9-4bb4-824c-e6768adc52fa tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:04.913227 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-43cbbba3-02e9-4bb4-824c-e6768adc52fa tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048976 Jul 29 05:00:04.913795 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 561/1116] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Jul 29 05:00:04 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:00:04.979661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:04.980879 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:04.982813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:04.983462 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:04.989784 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:04.990225 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:04.991005 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:04.991442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:05.019636 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:00:05.101132 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4b345ddc-cb79-43bc-96b4-7d750bd9d32b tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 204 len: 0 microversion: 2.20 time: 0.124963 Jul 29 05:00:05.102373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 556/1117] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Jul 29 05:00:04 2022] DELETE /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 05:00:05.111380 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:05.112357 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:05.119810 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:05.120271 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:05.121130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:05.121635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:05.286598 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:05.295250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:05.296860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:05.298041 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-af35ef3a-fb60-4f1b-815d-406ea0e0f5a1 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.190929 Jul 29 05:00:05.298799 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 562/1118] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 05:00:05 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 05:00:06.322817 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:06.323516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:06.331566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:06.332282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:06.333280 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:06.333894 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:06.490192 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:06.501479 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:06.503042 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:06.504228 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-38ea40df-627f-4bac-95ef-60635d94bbe4 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.185773 Jul 29 05:00:06.504839 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 557/1119] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 05:00:06 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:00:07.527790 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:07.529286 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:07.536202 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:07.536735 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:07.537503 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:07.537939 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:08.009669 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:08.018502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:08.020022 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1e1c24849d7480b8ac804a7e3d2ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e9e21d168140e99ffed71146e35fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:00:08.021241 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-381e7633-9da5-427b-924e-1b0e59dd33ef tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 200 len: 1721 microversion: 2.20 time: 0.498002 Jul 29 05:00:08.021993 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 563/1120] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 05:00:07 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 1721 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 05:00:08.399603 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-adfe53fc-cc16-4c66-b144-600ce8b303aa req-d448409b-5558-4564-a065-e38cc7603378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e997be3-f342-420b-8630-ca1f8847303a", "name": "network-vif-deleted", "tag": "89c67e7e-2b75-46a8-b24e-d4b2cd7a0832"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:00:08.410959 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-adfe53fc-cc16-4c66-b144-600ce8b303aa req-d448409b-5558-4564-a065-e38cc7603378 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:08.411400 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-adfe53fc-cc16-4c66-b144-600ce8b303aa req-d448409b-5558-4564-a065-e38cc7603378 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:08.423495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-adfe53fc-cc16-4c66-b144-600ce8b303aa req-d448409b-5558-4564-a065-e38cc7603378 service nova] Creating event network-vif-deleted:89c67e7e-2b75-46a8-b24e-d4b2cd7a0832 for instance 5e997be3-f342-420b-8630-ca1f8847303a on hv-cinder-85144 Jul 29 05:00:08.429566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-adfe53fc-cc16-4c66-b144-600ce8b303aa req-d448409b-5558-4564-a065-e38cc7603378 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033958 Jul 29 05:00:08.430317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 558/1121] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:00:09.045114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:09.045726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:09.052219 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:09.053045 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:09.053491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:09.053942 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:09.069977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] HTTP exception thrown: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Request method failure captured: Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a HTTP/1.1 Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42bXeWyCQfOtOEH09FiVyGiCoQLFYQn54ZEIsEZwxX7cn90tFIL2-8f5ZJ4BQeCCeqZ666MG2b61ZEz4JSZsrIsxqCWTFXOrcMR706aVGIy2fluNOozK1CzwUakRiGQsYpv3qa7iCuK3Lus4NsO8Cm5tsBYh39nyl0vX-yph8ZVsHXE Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:00:09.071581 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: a1e1c24849d7480b8ac804a7e3d2ab5a Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:09.073187 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '5e997be3-f342-420b-8630-ca1f8847303a'} Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:09.074117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:09.076199 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:09.077498 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Returning 404 to user: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:09.077498 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-78b43b3b-90d5-4cd4-a2de-0f77d1ec07c9 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 404 len: 111 microversion: 2.20 time: 0.032265 Jul 29 05:00:09.077498 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 564/1122] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 05:00:09 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:00:09.084581 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3ff72b74-b052-49b2-8c78-b11113ef9fa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '.version_select at 0x7f3c547b7f70>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:09.104495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3ff72b74-b052-49b2-8c78-b11113ef9fa8 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-434988108" status: 204 len: 0 microversion: 2.20 time: 0.024516 Jul 29 05:00:09.105519 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 559/1123] 10.222.0.40 () {60 vars in 1259 bytes} [Fri Jul 29 05:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-434988108 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 05:00:10.912967 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:10.913599 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:10.920741 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:10.921208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:10.922010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:10.922459 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:10.936449 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] HTTP exception thrown: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Request method failure captured: Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a HTTP/1.1 Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42bXeWyCQfOtOEH09FiVyGiCoQLFYQn54ZEIsEZwxX7cn90tFIL2-8f5ZJ4BQeCCeqZ666MG2b61ZEz4JSZsrIsxqCWTFXOrcMR706aVGIy2fluNOozK1CzwUakRiGQsYpv3qa7iCuK3Lus4NsO8Cm5tsBYh39nyl0vX-yph8ZVsHXE Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:00:10.938049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: a1e1c24849d7480b8ac804a7e3d2ab5a Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.939891 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '5e997be3-f342-420b-8630-ca1f8847303a'} Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:10.940840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.942374 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.943950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Returning 404 to user: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:10.943950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d7d5a83d-fa51-4831-8296-92ffcb8ae1a6 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 404 len: 111 microversion: 2.20 time: 0.030439 Jul 29 05:00:10.943950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 565/1124] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Jul 29 05:00:10 2022] DELETE /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:00:10.948658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:10.950091 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 5e997be3-f342-420b-8630-ca1f8847303a] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:10.957133 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:10.957677 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:10.958570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:10.959099 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:10.975572 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] HTTP exception thrown: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Request method failure captured: Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a HTTP/1.1 Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42bXeWyCQfOtOEH09FiVyGiCoQLFYQn54ZEIsEZwxX7cn90tFIL2-8f5ZJ4BQeCCeqZ666MG2b61ZEz4JSZsrIsxqCWTFXOrcMR706aVGIy2fluNOozK1CzwUakRiGQsYpv3qa7iCuK3Lus4NsO8Cm5tsBYh39nyl0vX-yph8ZVsHXE Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 05:00:10.977268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: a1e1c24849d7480b8ac804a7e3d2ab5a Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.979041 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '5e997be3-f342-420b-8630-ca1f8847303a'} Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:10.979868 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. Jul 29 05:00:10.981621 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:10.982731 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Returning 404 to user: Instance 5e997be3-f342-420b-8630-ca1f8847303a could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:10.982731 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-652a90bf-d6c0-4555-a31e-a50721c2da4c tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a" status: 404 len: 111 microversion: 2.20 time: 0.034414 Jul 29 05:00:10.982731 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 560/1125] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 05:00:10 2022] GET /compute/v2.1/servers/5e997be3-f342-420b-8630-ca1f8847303a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:00:12.118385 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:12.118860 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:12.125664 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:12.126119 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:12.126908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:12.127346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:12.141925 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] HTTP exception thrown: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Request method failure captured: Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca HTTP/1.1 Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42bXeWyCQfOtOEH09FiVyGiCoQLFYQn54ZEIsEZwxX7cn90tFIL2-8f5ZJ4BQeCCeqZ666MG2b61ZEz4JSZsrIsxqCWTFXOrcMR706aVGIy2fluNOozK1CzwUakRiGQsYpv3qa7iCuK3Lus4NsO8Cm5tsBYh39nyl0vX-yph8ZVsHXE Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:00:12.143527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: a1e1c24849d7480b8ac804a7e3d2ab5a Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.145278 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '630ff067-c10b-4ae9-8d92-c40d206fd0ca'} Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:12.146296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.147650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.149010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Returning 404 to user: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:12.149010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d4b25855-5aef-4152-b01a-5211193ab641 tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "DELETE /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 404 len: 111 microversion: 2.20 time: 0.030544 Jul 29 05:00:12.149010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 566/1126] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Jul 29 05:00:12 2022] DELETE /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:00:12.154366 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:12.154985 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] [instance: 630ff067-c10b-4ae9-8d92-c40d206fd0ca] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:00:12.161522 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:12.161987 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:12.162757 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:00:12.163204 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:00:12.177086 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] HTTP exception thrown: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Request method failure captured: Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca HTTP/1.1 Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42bXeWyCQfOtOEH09FiVyGiCoQLFYQn54ZEIsEZwxX7cn90tFIL2-8f5ZJ4BQeCCeqZ666MG2b61ZEz4JSZsrIsxqCWTFXOrcMR706aVGIy2fluNOozK1CzwUakRiGQsYpv3qa7iCuK3Lus4NsO8Cm5tsBYh39nyl0vX-yph8ZVsHXE Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 05:00:12.178614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8e9e21d168140e99ffed71146e35fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: f8e9e21d168140e99ffed71146e35fc4 Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1708945846 Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: a1e1c24849d7480b8ac804a7e3d2ab5a Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1708945846-project Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.180587 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '630ff067-c10b-4ae9-8d92-c40d206fd0ca'} Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:12.181787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. Jul 29 05:00:12.183575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:12.185169 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] Returning 404 to user: Instance 630ff067-c10b-4ae9-8d92-c40d206fd0ca could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:12.185169 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9200394f-8b1b-4a34-8339-ff85d9f2c03f tempest-AttachVolumeShelveTestJSON-1708945846 tempest-AttachVolumeShelveTestJSON-1708945846-project] 10.222.0.40 "GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca" status: 404 len: 111 microversion: 2.20 time: 0.030197 Jul 29 05:00:12.185169 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 561/1127] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Jul 29 05:00:12 2022] GET /compute/v2.1/servers/630ff067-c10b-4ae9-8d92-c40d206fd0ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:00:16.556815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c58adba2-320f-4720-b9cf-c8cbbbed65ed tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Action: 'create', calling method: .version_select at 0x7f3c54766310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1252232873", "metadata": {"Type": "work"}}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c58adba2-320f-4720-b9cf-c8cbbbed65ed tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Request method failure captured: Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 122 Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42lgEj0FZpAeMlTn5dLgf-nZ5PEJg3HstLQjobwjpi3aQYhkgcRnHVSEH6gVYxlp5Afja_tPB0GG67NQHQmVY58ubEIyTl0LaZoVkxXL5znDdYWJV3aSsTXXMxRUYqVJWFcSNX2JxtttYalPRfwXUodACIIezUMYs8Rgqrl33bwRF_0 Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:00:16.577331 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be43f7f8b2524be794f059135e941dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 49e029ab11e849d1a086c05bec640284 Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1252232873", "metadata": {"Type": "work"}}} Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: Jul 29 05:00:16.578963 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1252232873', 'metadata': {'Type': 'work'}}}} Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise error Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi '#$%' Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:16.579948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 05:00:16.581695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 05:00:16.583188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 05:00:16.583188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.583188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c58adba2-320f-4720-b9cf-c8cbbbed65ed tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:16.583188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c58adba2-320f-4720-b9cf-c8cbbbed65ed tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135172 Jul 29 05:00:16.583188 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 567/1128] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Jul 29 05:00:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:00:16.588398 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-624065b9-a296-4250-a8b4-0c1ba2abe78c tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Action: 'create', calling method: .version_select at 0x7f3c58c25c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-468769143", "metadata": {"Type": "work"}}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-624065b9-a296-4250-a8b4-0c1ba2abe78c tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Request method failure captured: Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 119 Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42lgEj0FZpAeMlTn5dLgf-nZ5PEJg3HstLQjobwjpi3aQYhkgcRnHVSEH6gVYxlp5Afja_tPB0GG67NQHQmVY58ubEIyTl0LaZoVkxXL5znDdYWJV3aSsTXXMxRUYqVJWFcSNX2JxtttYalPRfwXUodACIIezUMYs8Rgqrl33bwRF_0 Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 05:00:16.593223 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be43f7f8b2524be794f059135e941dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 49e029ab11e849d1a086c05bec640284 Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-468769143", "metadata": {"Type": "work"}}} Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: Jul 29 05:00:16.594838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-468769143', 'metadata': {'Type': 'work'}}}} Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise error Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi '0' Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:16.595872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 05:00:16.597779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 05:00:16.599239 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 05:00:16.599239 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.599239 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-624065b9-a296-4250-a8b4-0c1ba2abe78c tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:16.599239 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-624065b9-a296-4250-a8b4-0c1ba2abe78c tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010008 Jul 29 05:00:16.599239 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 562/1129] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Jul 29 05:00:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 29 05:00:16.603438 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-228a1f78-6adb-4c59-9f0c-ce4f2e5aebca tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Action: 'create', calling method: .version_select at 0x7f3c543060d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-21211787", "metadata": {"Type": "work"}}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-228a1f78-6adb-4c59-9f0c-ce4f2e5aebca tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Request method failure captured: Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 117 Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42lgEj0FZpAeMlTn5dLgf-nZ5PEJg3HstLQjobwjpi3aQYhkgcRnHVSEH6gVYxlp5Afja_tPB0GG67NQHQmVY58ubEIyTl0LaZoVkxXL5znDdYWJV3aSsTXXMxRUYqVJWFcSNX2JxtttYalPRfwXUodACIIezUMYs8Rgqrl33bwRF_0 Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:00:16.608120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be43f7f8b2524be794f059135e941dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 49e029ab11e849d1a086c05bec640284 Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-21211787", "metadata": {"Type": "work"}}} Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: Jul 29 05:00:16.609765 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-21211787', 'metadata': {'Type': 'work'}}}} Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise error Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi '' Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:16.610644 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 05:00:16.611971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 05:00:16.613320 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 05:00:16.613320 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.613320 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-228a1f78-6adb-4c59-9f0c-ce4f2e5aebca tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:16.613320 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-228a1f78-6adb-4c59-9f0c-ce4f2e5aebca tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009786 Jul 29 05:00:16.613320 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 568/1130] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Jul 29 05:00:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 05:00:16.619039 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-63984b82-8c4a-4128-9c23-b07bda70eefd tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Calling method '.version_select at 0x7f3c543b7670>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:16.648904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-63984b82-8c4a-4128-9c23-b07bda70eefd tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] HTTP exception thrown: Volume tempest-invalid-1834022717 could not be found. Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-63984b82-8c4a-4128-9c23-b07bda70eefd tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Request method failure captured: Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1834022717 HTTP/1.1 Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42lgEj0FZpAeMlTn5dLgf-nZ5PEJg3HstLQjobwjpi3aQYhkgcRnHVSEH6gVYxlp5Afja_tPB0GG67NQHQmVY58ubEIyTl0LaZoVkxXL5znDdYWJV3aSsTXXMxRUYqVJWFcSNX2JxtttYalPRfwXUodACIIezUMYs8Rgqrl33bwRF_0 Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 05:00:16.651915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be43f7f8b2524be794f059135e941dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 49e029ab11e849d1a086c05bec640284 Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Volume tempest-invalid-1834022717 could not be found. Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': 'tempest-invalid-1834022717'} Jul 29 05:00:16.653532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1834022717 could not be found. (HTTP 404) (Request-ID: req-ec212f45-f669-493d-a58c-6e62e1a2684a) Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.654499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:00:16.655853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1834022717 could not be found. Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:16.658050 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1834022717 could not be found. Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1834022717 could not be found. Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-63984b82-8c4a-4128-9c23-b07bda70eefd tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Returning 404 to user: Volume tempest-invalid-1834022717 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-63984b82-8c4a-4128-9c23-b07bda70eefd tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1834022717" status: 404 len: 99 microversion: 2.1 time: 0.038630 Jul 29 05:00:16.659700 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 563/1131] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Jul 29 05:00:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1834022717 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 29 05:00:16.662849 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-aec00194-1e43-42c1-82ce-829c01a9a0b9 tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003778 Jul 29 05:00:16.663346 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 569/1132] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Jul 29 05:00:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 05:00:16.673081 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-1d1740bc-5525-484b-8f62-65319ec90923 tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003805 Jul 29 05:00:16.673567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 564/1133] 10.222.0.40 () {58 vars in 1137 bytes} [Fri Jul 29 05:00:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 05:00:16.682391 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-db9751be-6258-4055-9593-8ea55d5a1adf tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Calling method '.version_select at 0x7f3c54766e50>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:16.710929 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-db9751be-6258-4055-9593-8ea55d5a1adf tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] HTTP exception thrown: Volume 826a259b-6392-4576-8257-e5bd8a07eb5b could not be found. Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-db9751be-6258-4055-9593-8ea55d5a1adf tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Request method failure captured: Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: DELETE /compute/v2.1/os-volumes/826a259b-6392-4576-8257-e5bd8a07eb5b HTTP/1.1 Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42lgEj0FZpAeMlTn5dLgf-nZ5PEJg3HstLQjobwjpi3aQYhkgcRnHVSEH6gVYxlp5Afja_tPB0GG67NQHQmVY58ubEIyTl0LaZoVkxXL5znDdYWJV3aSsTXXMxRUYqVJWFcSNX2JxtttYalPRfwXUodACIIezUMYs8Rgqrl33bwRF_0 Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:00:16.712913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be43f7f8b2524be794f059135e941dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 49e029ab11e849d1a086c05bec640284 Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Volume 826a259b-6392-4576-8257-e5bd8a07eb5b could not be found. Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '826a259b-6392-4576-8257-e5bd8a07eb5b'} Jul 29 05:00:16.715124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 826a259b-6392-4576-8257-e5bd8a07eb5b could not be found. (HTTP 404) (Request-ID: req-93013b6d-cb23-44b5-a515-3042c40dff36) Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.716016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 05:00:16.717445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 826a259b-6392-4576-8257-e5bd8a07eb5b could not be found. Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 05:00:16.718744 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 826a259b-6392-4576-8257-e5bd8a07eb5b could not be found. Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 826a259b-6392-4576-8257-e5bd8a07eb5b could not be found. Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-db9751be-6258-4055-9593-8ea55d5a1adf tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Returning 404 to user: Volume 826a259b-6392-4576-8257-e5bd8a07eb5b could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-db9751be-6258-4055-9593-8ea55d5a1adf tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/826a259b-6392-4576-8257-e5bd8a07eb5b" status: 404 len: 109 microversion: 2.1 time: 0.035731 Jul 29 05:00:16.720159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 570/1134] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Jul 29 05:00:16 2022] DELETE /compute/v2.1/os-volumes/826a259b-6392-4576-8257-e5bd8a07eb5b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:00:16.724569 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0997600b-3a74-4edc-82b4-b60820c63ee4 tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Calling method '.version_select at 0x7f3c5442b430>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:00:16.751721 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-0997600b-3a74-4edc-82b4-b60820c63ee4 tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] HTTP exception thrown: Volume cba35182-14d1-4664-898d-cda44ef81e0e could not be found. Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0997600b-3a74-4edc-82b4-b60820c63ee4 tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Request method failure captured: Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: GET /compute/v2.1/os-volumes/cba35182-14d1-4664-898d-cda44ef81e0e HTTP/1.1 Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42lgEj0FZpAeMlTn5dLgf-nZ5PEJg3HstLQjobwjpi3aQYhkgcRnHVSEH6gVYxlp5Afja_tPB0GG67NQHQmVY58ubEIyTl0LaZoVkxXL5znDdYWJV3aSsTXXMxRUYqVJWFcSNX2JxtttYalPRfwXUodACIIezUMYs8Rgqrl33bwRF_0 Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 05:00:16.753755 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_be43f7f8b2524be794f059135e941dd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/be43f7f8b2524be794f059135e941dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: be43f7f8b2524be794f059135e941dd0 Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-VolumesNegativeTest-808112228 Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 49e029ab11e849d1a086c05bec640284 Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-VolumesNegativeTest-808112228-project Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Volume cba35182-14d1-4664-898d-cda44ef81e0e could not be found. Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': 'cba35182-14d1-4664-898d-cda44ef81e0e'} Jul 29 05:00:16.755340 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cba35182-14d1-4664-898d-cda44ef81e0e could not be found. (HTTP 404) (Request-ID: req-6c50baa4-ca3a-464e-a504-b766932b2635) Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.756451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 05:00:16.757925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cba35182-14d1-4664-898d-cda44ef81e0e could not be found. Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 05:00:16.759303 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cba35182-14d1-4664-898d-cda44ef81e0e could not be found. Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cba35182-14d1-4664-898d-cda44ef81e0e could not be found. Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0997600b-3a74-4edc-82b4-b60820c63ee4 tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] Returning 404 to user: Volume cba35182-14d1-4664-898d-cda44ef81e0e could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0997600b-3a74-4edc-82b4-b60820c63ee4 tempest-VolumesNegativeTest-808112228 tempest-VolumesNegativeTest-808112228-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/cba35182-14d1-4664-898d-cda44ef81e0e" status: 404 len: 109 microversion: 2.1 time: 0.034424 Jul 29 05:00:16.760758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 565/1135] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Jul 29 05:00:16 2022] GET /compute/v2.1/os-volumes/cba35182-14d1-4664-898d-cda44ef81e0e => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 05:00:47.702360 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=12 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:47.703513 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=24 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:00:47.879705 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-04be888d-ba18-4e63-8617-ff0f5d9a5392 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Action: 'create', calling method: .version_select at 0x7f3c5432fe50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1199785720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuuOBq4YX1jb5bBtUJSGbN4YbiYMlzrTXTkpCf5DyXn78yBl/rpjGLOXwIABeTZKx2CB77W2FA3SzyeOIU99284HkAUJQX+moAH6oZJ+UZLi14lsXOJFVB8oARP5El0TA=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:00:47.895143 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-04be888d-ba18-4e63-8617-ff0f5d9a5392 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Getting quotas for project b586a0d507ca497589a504f9e2d44574. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:00:47.898997 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-04be888d-ba18-4e63-8617-ff0f5d9a5392 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Getting quotas for user ead3628943944bbeabaa2e6a80b99f74 and project b586a0d507ca497589a504f9e2d44574. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:00:47.922307 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-04be888d-ba18-4e63-8617-ff0f5d9a5392 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.221408 Jul 29 05:00:47.923008 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 571/1136] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 05:00:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:00:51.653562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:00:51.654123 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 05:00:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:00:52.312862 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:00:52.313430 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:00:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:01:15.751341 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:15.752096 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:15.756387 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-359345719", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1199785720", "security_groups": [{"name": "tempest-secgroup-smoke-1135772892"}], "networks": [{"uuid": "ac70cb08-b25c-4351-9af8-2a46a3f3e6e9"}], "block_device_mapping_v2": [{"uuid": "4e4b23e3-b670-4c03-beaf-2e988ad758a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:01:15.902795 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] validate_networks() for [('ac70cb08-b25c-4351-9af8-2a46a3f3e6e9', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:01:16.564296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:01:16.564783 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:01:16.565252 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:01:16.565662 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:01:16.566075 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:01:16.575537 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:16.575991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:16.576838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:16.577288 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:16.597586 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Getting quotas for project b586a0d507ca497589a504f9e2d44574. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:01:16.601762 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Getting quotas for user ead3628943944bbeabaa2e6a80b99f74 and project b586a0d507ca497589a504f9e2d44574. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:01:16.663816 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:01:16.666128 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e4b23e3-b670-4c03-beaf-2e988ad758a6',volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:01:16.818986 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c6bdecc2-a9ce-4122-9c8d-f373098e8022 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.068819 Jul 29 05:01:16.819611 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 566/1137] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 05:01:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:01:16.828937 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=4 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:16.831127 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:16.835792 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-476663b3-3bfa-45a3-b0f1-cff2758911a6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:16.836430 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-476663b3-3bfa-45a3-b0f1-cff2758911a6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:16.912107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-476663b3-3bfa-45a3-b0f1-cff2758911a6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:16.921445 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-476663b3-3bfa-45a3-b0f1-cff2758911a6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1088 microversion: 2.1 time: 0.094224 Jul 29 05:01:16.922249 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 572/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:16 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:17.948112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:17.949463 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:17.964160 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:17.964647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:17.965569 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:17.966209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:18.083085 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:18.091708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b3ea0496-12b7-4a74-ae7e-2a04e57a21d5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1186 microversion: 2.1 time: 0.151569 Jul 29 05:01:18.105968 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 567/1139] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:17 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1186 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:19.116840 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:19.117543 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:19.130695 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:19.133904 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:19.136240 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:19.137270 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:19.263023 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:19.272917 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cbd8c940-477c-4ee5-9a3b-519ed37c68df tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1192 microversion: 2.1 time: 0.163515 Jul 29 05:01:19.273500 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 573/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:19 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1192 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:20.295833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:20.297076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:20.308285 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:20.314107 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:20.315728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:20.317321 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:20.788023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:20.809585 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c7233f44-8931-4389-8c34-2fedbad21bd8 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.517506 Jul 29 05:01:20.810537 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 568/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:20 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:01:21.226613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-1463c092-8064-4e64-b647-acfbb9dc82d7 req-e263106a-88f9-4338-bad3-dc6bd86da387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8b3fba-7def-4a73-9c76-0b4871f244e9", "tag": "1a26b861-617c-4ef6-b856-a16b66ee0360"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:01:21.253550 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-1463c092-8064-4e64-b647-acfbb9dc82d7 req-e263106a-88f9-4338-bad3-dc6bd86da387 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:21.254260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-1463c092-8064-4e64-b647-acfbb9dc82d7 req-e263106a-88f9-4338-bad3-dc6bd86da387 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:21.285628 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-1463c092-8064-4e64-b647-acfbb9dc82d7 req-e263106a-88f9-4338-bad3-dc6bd86da387 service nova] Creating event network-changed:1a26b861-617c-4ef6-b856-a16b66ee0360 for instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 on hv-cinder-85144 Jul 29 05:01:21.297722 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-1463c092-8064-4e64-b647-acfbb9dc82d7 req-e263106a-88f9-4338-bad3-dc6bd86da387 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081513 Jul 29 05:01:21.300532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 574/1142] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:01:21.837932 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:21.838559 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:21.855877 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:21.857395 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:21.859658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:21.860268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:22.139619 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:22.172464 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ded0ad5d-f223-42c5-b885-b43688741d93 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.345653 Jul 29 05:01:22.195885 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 569/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:21 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:22.966156 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e55b34f2-d11e-4160-ac08-10f7339abf98 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Action: 'create', calling method: .version_select at 0x7f3c54291820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-262120479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmgpG5QKqgLIzhlsnr5R9an05HUTSiyzYnGkehcU0wYSdSz+xBSqWTF93hj3ZTHk3tFCJQwwBiU/8NKF7rN7TdxVyfzIIdHt44ou1U862A94rcdOqpyHk9S68F1oi4Ikw=="}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:01:22.982507 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-e55b34f2-d11e-4160-ac08-10f7339abf98 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:01:22.986914 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-e55b34f2-d11e-4160-ac08-10f7339abf98 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for user 6fd1b82319424fb8bd7e50bc0cb00037 and project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'key_pairs'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:01:23.011367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e55b34f2-d11e-4160-ac08-10f7339abf98 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.212723 Jul 29 05:01:23.011978 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 575/1144] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Jul 29 05:01:22 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:01:23.203330 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:23.207468 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:23.214315 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:23.215015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:23.216028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:23.216658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:23.400466 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:23.412056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4ab326c0-eae5-47f8-bb4d-580441a98596 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.216193 Jul 29 05:01:23.424544 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 570/1145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:23 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:24.436048 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:24.437523 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:24.446501 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:24.446962 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:24.447888 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:24.448536 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:24.629671 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:24.637356 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3d01dbb6-76fa-4880-a280-c36ef6299382 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.205862 Jul 29 05:01:24.637941 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 576/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:24 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:25.660996 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:25.661627 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:25.668685 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:25.669505 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:25.670857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:25.671435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:25.817365 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:25.825279 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2277665a-df0c-4ec3-a408-2b64c50ce416 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.168258 Jul 29 05:01:25.825861 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 571/1147] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:25 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:26.846586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:26.847307 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:26.854232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:26.854681 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:26.855484 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:26.855921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:26.992149 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:26.999521 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0d88eae6-79ac-4e0f-a6bb-62cf4bf39cbe tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.156878 Jul 29 05:01:27.000079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 577/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:26 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:28.021423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:28.022043 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:28.023878 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:28.024762 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:28.030951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:28.031409 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:28.032184 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:28.032647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:28.165066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:28.172813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d9531220-737c-4901-b53b-e5df133c2fa1 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.155946 Jul 29 05:01:28.173380 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 572/1149] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:28 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:29.194856 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:29.195440 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:29.201797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:29.202247 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:29.203072 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:29.203509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:29.373308 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:29.386222 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3c846fda-cdcb-40f7-b07b-2bce2edbfa39 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.195901 Jul 29 05:01:29.386808 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 578/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:29 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:30.410477 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:30.411145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:30.420418 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:30.420908 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:30.421714 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:30.422180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:30.558415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:30.565908 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5c5aec42-f1aa-4211-b752-ea554f0a0fb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.161035 Jul 29 05:01:30.566502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 573/1151] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:30 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:31.587883 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:31.588502 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:31.595354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:31.595820 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:31.596636 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:31.597076 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:31.732252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:31.740238 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-847738b8-fa58-4652-85c8-c93820ee8ec5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.156981 Jul 29 05:01:31.740865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 579/1152] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:31 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:32.333540 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-1e9203ee-df6c-4729-8733-5820f2542fc2 req-1cf947c8-3072-438d-9584-7df935afc55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8b3fba-7def-4a73-9c76-0b4871f244e9", "name": "network-vif-plugged", "status": "completed", "tag": "1a26b861-617c-4ef6-b856-a16b66ee0360"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:01:32.343966 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-1e9203ee-df6c-4729-8733-5820f2542fc2 req-1cf947c8-3072-438d-9584-7df935afc55d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:32.344417 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-1e9203ee-df6c-4729-8733-5820f2542fc2 req-1cf947c8-3072-438d-9584-7df935afc55d service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:32.359606 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-1e9203ee-df6c-4729-8733-5820f2542fc2 req-1cf947c8-3072-438d-9584-7df935afc55d service nova] Creating event network-vif-plugged:1a26b861-617c-4ef6-b856-a16b66ee0360 for instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 on hv-cinder-85144 Jul 29 05:01:32.364689 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-1e9203ee-df6c-4729-8733-5820f2542fc2 req-1cf947c8-3072-438d-9584-7df935afc55d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Jul 29 05:01:32.365973 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 574/1153] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:01:32.760735 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:32.761334 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:32.767948 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:32.768403 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:32.769200 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:32.769645 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:32.903394 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:32.911024 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-94ed87e4-7f6b-44a4-add8-c9802721835a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.154409 Jul 29 05:01:32.911594 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 580/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:32 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:33.934347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:33.935076 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:33.941269 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:33.941715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:33.942468 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:33.942904 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:34.082551 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:34.090550 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4e861385-d6e4-4c48-8007-f4a9e990a20a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1260 microversion: 2.1 time: 0.160867 Jul 29 05:01:34.091117 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 575/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:33 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:35.111235 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:35.111849 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:35.113806 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:35.120151 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:35.120630 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:35.121417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:35.121857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:35.250580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:35.258615 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5ee38962-3e5e-47d2-a794-d2c08b8780dd tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1443 microversion: 2.1 time: 0.151309 Jul 29 05:01:35.259173 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 581/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:35 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:35.279623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:35.280236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:35.286602 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:35.287051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:35.288008 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:35.288447 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:35.419068 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:35.426872 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b2aa147e-c199-4e93-83a5-cd691caf697c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1443 microversion: 2.1 time: 0.151180 Jul 29 05:01:35.427436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 576/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:35 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:37.204787 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-b87e2d02-02e2-4997-b0d6-834af2df71ae req-7205ff5e-c9ea-4ed6-b265-95988bc53818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8b3fba-7def-4a73-9c76-0b4871f244e9", "tag": "1a26b861-617c-4ef6-b856-a16b66ee0360"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:01:37.217665 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b87e2d02-02e2-4997-b0d6-834af2df71ae req-7205ff5e-c9ea-4ed6-b265-95988bc53818 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:37.218283 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-b87e2d02-02e2-4997-b0d6-834af2df71ae req-7205ff5e-c9ea-4ed6-b265-95988bc53818 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:37.230952 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-b87e2d02-02e2-4997-b0d6-834af2df71ae req-7205ff5e-c9ea-4ed6-b265-95988bc53818 service nova] Creating event network-changed:1a26b861-617c-4ef6-b856-a16b66ee0360 for instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 on hv-cinder-85144 Jul 29 05:01:37.236184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-b87e2d02-02e2-4997-b0d6-834af2df71ae req-7205ff5e-c9ea-4ed6-b265-95988bc53818 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096308 Jul 29 05:01:37.237093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 582/1158] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:01:44.702257 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1860067619", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-262120479", "security_groups": [{"name": "tempest-secgroup-smoke-2066975548"}], "block_device_mapping_v2": [{"uuid": "4267a99f-9f81-41b9-b188-421543e01068", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8d51233-0dc5-4999-a537-b5dd4b1ae8b7"}]}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:01:44.814601 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] validate_networks() for [('a8d51233-0dc5-4999-a537-b5dd4b1ae8b7', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:01:45.176973 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:01:45.177405 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:01:45.178608 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:01:45.179144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:01:45.179564 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:01:45.188495 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:45.189045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:45.189862 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:45.190307 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:45.208304 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:01:45.212594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for user 6fd1b82319424fb8bd7e50bc0cb00037 and project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:01:45.269069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:01:45.271127 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4267a99f-9f81-41b9-b188-421543e01068',volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:01:45.401892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ddc5c3ae-2a0e-46e3-a6e0-620455db4862 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703390 Jul 29 05:01:45.402516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 577/1159] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 05:01:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:01:45.414232 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5a452de0-10ef-4318-910a-48734deb52bc tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:45.415575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5a452de0-10ef-4318-910a-48734deb52bc tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:45.474220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5a452de0-10ef-4318-910a-48734deb52bc tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:45.481516 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5a452de0-10ef-4318-910a-48734deb52bc tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1094 microversion: 2.1 time: 0.072059 Jul 29 05:01:45.482243 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 583/1160] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:45 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:46.502722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:46.503339 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:46.505822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:46.513035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:46.513498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:46.515726 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:46.515726 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:46.519425 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=61 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:46.584965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:46.592926 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-88d33b7d-0892-4a09-86e2-b2d25a9a189a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1210 microversion: 2.1 time: 0.094024 Jul 29 05:01:46.593593 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 578/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:46 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:47.614584 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:47.615216 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:47.618673 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=46 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:47.620545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:47.629123 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:47.629685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:47.630588 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:47.631103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:48.099732 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:48.108814 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-b544431a-a61f-43b6-a785-a9690cda456f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.498145 Jul 29 05:01:48.109794 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 584/1162] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:47 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:48.169114 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-c7e1aaca-635f-4f1e-a637-2b2c0ae36b3d req-604cb290-2ff7-4141-ae0e-c4a50dec94a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65045a08-7888-448b-b52a-67750317b2d1", "tag": "c811e59d-1fd7-4b9e-a75b-edec92b21f25"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:01:48.184062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-c7e1aaca-635f-4f1e-a637-2b2c0ae36b3d req-604cb290-2ff7-4141-ae0e-c4a50dec94a4 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:48.184639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-c7e1aaca-635f-4f1e-a637-2b2c0ae36b3d req-604cb290-2ff7-4141-ae0e-c4a50dec94a4 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:48.198191 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-c7e1aaca-635f-4f1e-a637-2b2c0ae36b3d req-604cb290-2ff7-4141-ae0e-c4a50dec94a4 service nova] Creating event network-changed:c811e59d-1fd7-4b9e-a75b-edec92b21f25 for instance 65045a08-7888-448b-b52a-67750317b2d1 on hv-cinder-85144 Jul 29 05:01:48.204080 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-c7e1aaca-635f-4f1e-a637-2b2c0ae36b3d req-604cb290-2ff7-4141-ae0e-c4a50dec94a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041548 Jul 29 05:01:48.205038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 579/1163] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:01:49.130511 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:49.131121 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:49.138162 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:49.138616 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:49.139385 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:49.139829 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:49.273970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:49.281431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d4b56a18-d8a4-42e9-b100-a180ef952c49 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.154902 Jul 29 05:01:49.281994 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 585/1164] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:49 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:50.303375 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:50.304195 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:50.310478 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:50.310936 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:50.311710 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:50.312159 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:50.444675 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:50.452546 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5327f761-2ec3-4e25-9061-9cc78d708879 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.154006 Jul 29 05:01:50.453146 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 580/1165] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:50 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:51.473878 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:51.474479 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:51.481508 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:51.481967 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:51.482735 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:51.483178 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:51.613858 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:51.621437 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6d9ae593-a23f-4bf8-a525-7cbd66ce0c44 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.151540 Jul 29 05:01:51.622012 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 586/1166] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:51 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:52.642948 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:52.643555 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:52.650573 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:52.651035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:52.651817 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:52.652615 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:52.782236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:52.790034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2d1e59fc-8970-410f-ab57-dc8d85fcc72b tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.150940 Jul 29 05:01:52.790622 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 581/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:52 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:53.810869 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:53.811823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:53.818351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:53.818810 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:53.819580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:53.820026 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:53.949483 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:53.956993 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4c493936-e5a9-47c6-82ea-6af008b97d21 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.150289 Jul 29 05:01:53.957558 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 587/1168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:53 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:54.978567 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:54.979137 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:54.985972 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:54.986436 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:54.987222 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:54.987672 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:55.123758 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:55.131219 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9f67faff-bca5-4df5-9cd3-43f766bc7372 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.157503 Jul 29 05:01:55.131791 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 582/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:54 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:56.152640 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:56.153252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:56.155620 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:56.161046 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:56.161495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:56.162250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:56.162685 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:56.298657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:56.306931 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4a2e10a5-b0a8-4264-b4b4-4f2547b3e12c tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.158133 Jul 29 05:01:56.307505 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 588/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:56 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:57.327446 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:57.328097 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:57.329935 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:57.330583 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=6 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:01:57.337779 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:57.338236 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:57.339015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:57.339451 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:57.469925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:57.477885 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0b49ac74-5e78-48fa-b0ac-412654d7d8de tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.154416 Jul 29 05:01:57.478452 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 583/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:57 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:58.499067 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:58.499796 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:58.506679 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:58.507133 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:58.507911 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:58.508351 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:58.643228 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:58.650791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f5fadf35-8dbb-446d-a45e-72046902ade9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.155657 Jul 29 05:01:58.651362 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 589/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:58 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:01:59.671728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:01:59.672342 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:01:59.678906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:59.679355 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:59.680112 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:01:59.680549 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:01:59.812934 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:01:59.820731 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d5408e01-f9d1-449c-a8a7-c1cc8cc40ad5 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.153003 Jul 29 05:01:59.821404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 584/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:01:59 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:02:00.482809 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-1d219c4e-915e-4b83-bcef-6addee46109a req-dda8d14b-c66b-4dac-a10d-17572108332c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65045a08-7888-448b-b52a-67750317b2d1", "name": "network-vif-plugged", "status": "completed", "tag": "c811e59d-1fd7-4b9e-a75b-edec92b21f25"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:02:00.492619 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-1d219c4e-915e-4b83-bcef-6addee46109a req-dda8d14b-c66b-4dac-a10d-17572108332c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:00.493081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-1d219c4e-915e-4b83-bcef-6addee46109a req-dda8d14b-c66b-4dac-a10d-17572108332c service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:00.505256 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-1d219c4e-915e-4b83-bcef-6addee46109a req-dda8d14b-c66b-4dac-a10d-17572108332c service nova] Creating event network-vif-plugged:c811e59d-1fd7-4b9e-a75b-edec92b21f25 for instance 65045a08-7888-448b-b52a-67750317b2d1 on hv-cinder-85144 Jul 29 05:02:00.510350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-1d219c4e-915e-4b83-bcef-6addee46109a req-dda8d14b-c66b-4dac-a10d-17572108332c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032491 Jul 29 05:02:00.510942 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 590/1174] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:02:00.842375 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:02:00.842993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:02:00.849574 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:00.850057 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:00.850823 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:00.851268 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:00.983054 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:02:00.990591 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-cfc55252-c373-4591-b5cf-d8c58da3bc41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.152091 Jul 29 05:02:00.991168 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 585/1175] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:02:00 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:02:02.012332 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:02:02.013068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:02:02.019344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:02.019802 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:02.020572 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:02.021045 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:02.151474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:02:02.159119 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4fe56cda-1f5e-42e5-a353-5faaabc4d2b2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1266 microversion: 2.1 time: 0.151695 Jul 29 05:02:02.159728 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 591/1176] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:02:02 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:02:03.181391 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:02:03.182066 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:02:03.188553 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:03.189047 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:03.189815 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:03.190257 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:03.318661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:02:03.326232 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-846e17d2-231b-40df-a460-05e818485ad7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1453 microversion: 2.1 time: 0.149468 Jul 29 05:02:03.326813 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 586/1177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:02:03 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:02:03.346608 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:02:03.347221 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:02:03.354124 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:03.354569 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:03.355322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:03.355759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:03.486843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:02:03.494970 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-72f55262-f0a5-40a2-a0d1-798c4a2321be tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1453 microversion: 2.1 time: 0.152242 Jul 29 05:02:03.495541 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 592/1178] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:02:03 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:02:05.102752 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-72b40cee-039c-4d67-85d6-ba412a5cb07b req-454cf08d-0c67-4c35-9722-ef0dba97b732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65045a08-7888-448b-b52a-67750317b2d1", "tag": "c811e59d-1fd7-4b9e-a75b-edec92b21f25"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:02:05.112901 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-72b40cee-039c-4d67-85d6-ba412a5cb07b req-454cf08d-0c67-4c35-9722-ef0dba97b732 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:02:05.113423 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-72b40cee-039c-4d67-85d6-ba412a5cb07b req-454cf08d-0c67-4c35-9722-ef0dba97b732 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:02:05.125243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-72b40cee-039c-4d67-85d6-ba412a5cb07b req-454cf08d-0c67-4c35-9722-ef0dba97b732 service nova] Creating event network-changed:c811e59d-1fd7-4b9e-a75b-edec92b21f25 for instance 65045a08-7888-448b-b52a-67750317b2d1 on hv-cinder-85144 Jul 29 05:02:05.130442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-72b40cee-039c-4d67-85d6-ba412a5cb07b req-454cf08d-0c67-4c35-9722-ef0dba97b732 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 Jul 29 05:02:05.131061 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 587/1179] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:03:53.154084 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4cc2955-a473-4ccb-9ceb-bd2b9d6452b6] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 05:03:53.154899 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=17 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:03:53.155696 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=50 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:03:53.160762 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:03:53.161299 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:03:53.168241 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:53.168727 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:53.170139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:53.170575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:53.194184 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.objects.instance [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lazy-loading 'flavor' on Instance uuid 0d8b3fba-7def-4a73-9c76-0b4871f244e9 {{(pid=129684) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 05:03:53.269474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-aa005893-5824-4a4d-83ec-0c565ae7bff6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "POST /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9/action" status: 202 len: 0 microversion: 2.1 time: 0.117270 Jul 29 05:03:53.270065 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 593/1180] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 05:03:53 2022] POST /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:03:53.276699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bccb451-faf5-4b70-b731-d80bb9097efe] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 05:03:53.277309 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=19 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:03:53.278117 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=51 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:03:53.282768 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:03:53.283548 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:03:53.291596 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:53.292056 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:53.293045 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:53.293475 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:53.484038 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:03:53.491705 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c8062ec9-d3bf-4f1a-91d8-d27acdbb59e7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.216874 Jul 29 05:03:53.492262 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 588/1181] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:03:53 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:03:54.514362 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:03:54.515061 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:03:54.522340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:54.522785 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:54.523540 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:54.523971 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:54.527384 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4cc2955-a473-4ccb-9ceb-bd2b9d6452b6] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 54048. Jul 29 05:03:54.710281 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:03:54.718056 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-bc93c3a9-b5d9-4334-8de9-a8619344b120 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.209113 Jul 29 05:03:54.718647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 594/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:03:54 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:03:55.739977 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:03:55.740639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:03:55.748381 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:55.748852 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:55.749614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:55.750047 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:55.755876 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bccb451-faf5-4b70-b731-d80bb9097efe] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 54054. Jul 29 05:03:55.880197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:03:55.887679 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-5b95d40c-6d69-4199-9fea-ad1b1688643d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.152291 Jul 29 05:03:55.888245 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 589/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:03:55 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:03:56.909026 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:03:56.909579 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:03:56.916037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:56.916495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:56.917264 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:56.917701 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:57.053178 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:03:57.060638 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-73a3bb1f-3559-4ba1-83f2-5051b02b767b tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.155573 Jul 29 05:03:57.061196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 595/1184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:03:56 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:03:58.082450 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:03:58.083074 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:03:58.089616 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:58.090073 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:58.090845 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:58.091289 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:58.223188 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:03:58.230730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-711fa91d-ff5b-4f6d-b8fb-82a9391ce4b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.152251 Jul 29 05:03:58.231533 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 590/1185] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:03:58 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:03:59.253003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:03:59.253650 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:03:59.260022 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:59.260471 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:59.261262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:03:59.261731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:03:59.388305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:03:59.395908 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9b498c4f-082f-447a-96f6-43eef9ae2227 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.147368 Jul 29 05:03:59.396472 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 596/1186] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:03:59 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:00.417802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:00.418531 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:00.425911 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:00.426368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:00.427142 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:00.427584 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:00.556490 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:00.564034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a53ec870-7ac4-46c1-9288-39a5370e46cf tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.150316 Jul 29 05:04:00.564613 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 591/1187] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:00 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:01.586120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:01.586718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:01.593155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:01.593609 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:01.594370 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:01.594809 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:01.728684 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:01.736200 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e8c51764-b8c6-4ce2-910a-79a67058939a tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.153996 Jul 29 05:04:01.737350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 597/1188] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:01 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:02.757949 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:02.758569 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:02.765150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:02.765644 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:02.766411 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:02.766856 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:03.146892 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:03.154347 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8b23b3ee-6226-4088-aba5-85f681184cb2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.400339 Jul 29 05:04:03.154919 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 592/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:02 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:04.176439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:04.177023 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:04.183854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:04.184319 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:04.185117 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:04.185575 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:04.315574 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:04.323206 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2eea1f7d-65c8-4c66-b87f-57a9ad4911c2 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.150808 Jul 29 05:04:04.323773 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 598/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:04 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:05.345220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:05.346353 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:05.352931 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:05.353377 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:05.354131 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:05.354566 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:05.482916 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:05.490721 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-28229ee7-2be2-4980-8a03-f52d9417f71d tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.149383 Jul 29 05:04:05.491290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 593/1191] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:05 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:06.512226 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:06.512854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:06.519817 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:06.520266 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:06.521052 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:06.521491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:06.659826 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:06.667537 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e3216b33-53c8-4d38-9370-f37b472addbc tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1568 microversion: 2.1 time: 0.159222 Jul 29 05:04:06.668103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 599/1192] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:06 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:06.688389 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:06.689003 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:06.695414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:06.695863 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:06.696764 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:06.697202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:06.737499 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129683) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 05:04:06.805963 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [80db74e8-ab8e-4e5d-8533-4c9347b1ec15] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 05:04:07.812906 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [80db74e8-ab8e-4e5d-8533-4c9347b1ec15] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 54082. Jul 29 05:04:07.816154 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8b62e9cc-d062-4f21-ae8b-b896160606e6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "POST /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9/action" status: 202 len: 0 microversion: 2.1 time: 1.131577 Jul 29 05:04:07.816986 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 594/1193] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Jul 29 05:04:06 2022] POST /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:04:07.825304 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:07.825921 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:07.833094 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:07.833487 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:07.834272 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:07.834719 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:08.001540 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:08.009280 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-2d44fd15-2b5a-46d5-a8b8-448b6e297742 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1516 microversion: 2.1 time: 0.187730 Jul 29 05:04:08.009854 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 600/1194] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:07 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:09.031342 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:09.031962 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:09.040193 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:09.040420 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-ad3a074c-440b-4d68-aaf4-109384220b5f req-6f40cda4-48a8-4cb3-bcc7-5d946a31a7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8b3fba-7def-4a73-9c76-0b4871f244e9", "name": "network-vif-unplugged", "status": "completed", "tag": "1a26b861-617c-4ef6-b856-a16b66ee0360"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:09.041467 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:09.042360 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:09.042991 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:09.052331 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ad3a074c-440b-4d68-aaf4-109384220b5f req-6f40cda4-48a8-4cb3-bcc7-5d946a31a7d5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:09.052829 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-ad3a074c-440b-4d68-aaf4-109384220b5f req-6f40cda4-48a8-4cb3-bcc7-5d946a31a7d5 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:09.063988 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.compute.server_external_events [req-ad3a074c-440b-4d68-aaf4-109384220b5f req-6f40cda4-48a8-4cb3-bcc7-5d946a31a7d5 service nova] Unable to find a host for instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9. Dropping event network-vif-unplugged {{(pid=129683) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 05:04:09.065554 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-ad3a074c-440b-4d68-aaf4-109384220b5f req-6f40cda4-48a8-4cb3-bcc7-5d946a31a7d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089953 Jul 29 05:04:09.067880 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 595/1195] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 93 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 29 05:04:09.193019 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:09.200586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-4dea211c-c09f-444c-b29b-d82e47a052ba tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1516 microversion: 2.1 time: 0.173005 Jul 29 05:04:09.201423 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 601/1196] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:09 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:10.222366 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:10.223032 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:10.229435 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:10.229890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:10.230647 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:10.231086 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:10.364696 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:10.372387 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0c62fa07-e3bd-47a1-b6ce-bee8b2881401 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1516 microversion: 2.1 time: 0.153979 Jul 29 05:04:10.372981 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 596/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:10 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:11.393497 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:11.394111 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:11.400545 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:11.401028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:11.401825 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:11.402262 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:11.536333 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:11.544939 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3cca6fb0-ac11-4801-8436-18e6eb0a59c6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1516 microversion: 2.1 time: 0.155380 Jul 29 05:04:11.545509 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 602/1198] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:11 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:12.321305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:04:12.321522 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:04:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:04:12.567655 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:12.568271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:12.574821 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:12.575220 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:12.575991 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:12.576434 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:12.711352 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:12.719883 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-05e51943-f770-4547-b6fd-fd13e7f5ab73 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1516 microversion: 2.1 time: 0.156805 Jul 29 05:04:12.720568 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 597/1199] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:12 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:13.742178 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:13.742791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:13.749253 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:13.749704 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:13.750527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:13.750984 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:13.969013 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:13.977150 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-472b939d-6d69-4914-a485-107d329a59aa tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.238943 Jul 29 05:04:13.977727 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 603/1200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:13 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:14.999329 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:14.999954 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:15.006639 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:15.007094 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:15.007869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:15.008317 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:15.139438 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:15.147535 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-35f28721-e031-44cf-a84c-b14f2ec757b7 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.152123 Jul 29 05:04:15.148103 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 598/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:14 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:16.168861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:16.169469 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:16.176913 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:16.177297 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:16.178079 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:16.178510 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:16.231523 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:04:16.231768 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 (ip 10.222.0.40) !!! Jul 29 05:04:16.310772 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:16.318367 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3e5ae284-b623-4106-be8b-2bc4e1aada08 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.153353 Jul 29 05:04:16.318941 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 604/1202] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:16 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:17.339183 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:17.339780 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:17.346352 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:17.346803 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:17.347555 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:17.348058 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:17.483039 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:17.491738 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-bde867b2-2d0d-4126-9f00-5a484d369045 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.156422 Jul 29 05:04:17.492300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 599/1203] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:17 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:18.513657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:18.514281 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:18.520880 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:18.521332 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:18.522100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:18.522542 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:18.657916 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:18.665770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-29f58fbd-10c7-4bdc-b830-53199a01cbc5 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.156031 Jul 29 05:04:18.666341 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 605/1204] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:18 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:19.686136 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:19.686789 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:19.693531 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:19.693989 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:19.694763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:19.695212 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:19.822893 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:19.830271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-580dbeb3-4829-462a-8546-71443a849ee4 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.147994 Jul 29 05:04:19.830838 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 600/1205] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:19 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:20.194142 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:20.194686 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:20.201128 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:20.201580 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:20.202340 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:20.202808 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:20.227872 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Going to try to terminate instance {{(pid=129684) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:04:20.253405 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:04:20.302393 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cbd024ed-ccb4-443f-93bc-223ddeab19ce tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "DELETE /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 204 len: 0 microversion: 2.1 time: 0.112288 Jul 29 05:04:20.302890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 606/1206] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 05:04:20 2022] DELETE /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:04:20.310824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:20.311471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:20.318052 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:20.318502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:20.319266 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:20.319706 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:20.453802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:20.461941 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-2d945ace-c47a-4439-845e-6d759ac4ae89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1578 microversion: 2.1 time: 0.154883 Jul 29 05:04:20.462516 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 601/1207] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:20 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:20.853350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:20.854053 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:20.860035 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:20.860486 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:20.861306 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:20.861747 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:20.992745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:21.000239 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-6432f717-6092-42e5-a6ec-cf7129fea992 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.151206 Jul 29 05:04:21.000831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 607/1208] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:20 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:21.483902 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:21.484552 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:21.491887 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:21.492345 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:21.493150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:21.493618 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:21.625746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:21.633592 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ec4ad729-244b-4033-8619-ce19d85fcd73 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1578 microversion: 2.1 time: 0.153592 Jul 29 05:04:21.634170 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 602/1209] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:21 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:22.022498 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:22.023119 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:22.029285 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:22.029819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:22.030586 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:22.031031 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:22.168031 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:22.175797 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d60ec441-e070-4d49-9bef-8d108c1d4335 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.157810 Jul 29 05:04:22.176371 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 608/1210] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:22 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:22.654746 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:22.655461 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:22.662866 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:22.663350 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:22.664205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:22.664715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:22.797556 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:22.806394 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a44769a5-d3cb-4f96-9358-d99bec246eb8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1578 microversion: 2.1 time: 0.155945 Jul 29 05:04:22.806951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 603/1211] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:22 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:23.197198 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:23.197877 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:23.200634 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:04:23.205932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:23.206387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:23.207155 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:23.207601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:23.430659 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:23.438354 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-0e1633fa-66bd-495a-9bf0-8c391b9996b6 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.245625 Jul 29 05:04:23.439018 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 609/1212] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:23 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:23.828763 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:23.829386 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:23.831735 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:04:23.838083 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:23.838563 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:23.839404 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:23.839908 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:23.843218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:04:23.904965 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:23.913356 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8655fb76-314c-44a1-84b7-19182472a1d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 200 len: 1510 microversion: 2.1 time: 0.088514 Jul 29 05:04:23.913925 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 604/1213] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:23 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:24.107890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-0dcd7e56-24c6-403a-82f7-fc3ad74dedfd req-95528834-7897-4468-822a-2fba912c0609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65045a08-7888-448b-b52a-67750317b2d1", "name": "network-vif-deleted", "tag": "c811e59d-1fd7-4b9e-a75b-edec92b21f25"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:24.120439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-0dcd7e56-24c6-403a-82f7-fc3ad74dedfd req-95528834-7897-4468-822a-2fba912c0609 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:24.120922 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-0dcd7e56-24c6-403a-82f7-fc3ad74dedfd req-95528834-7897-4468-822a-2fba912c0609 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:24.133427 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-0dcd7e56-24c6-403a-82f7-fc3ad74dedfd req-95528834-7897-4468-822a-2fba912c0609 service nova] Creating event network-vif-deleted:c811e59d-1fd7-4b9e-a75b-edec92b21f25 for instance 65045a08-7888-448b-b52a-67750317b2d1 on hv-cinder-85144 Jul 29 05:04:24.138912 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-0dcd7e56-24c6-403a-82f7-fc3ad74dedfd req-95528834-7897-4468-822a-2fba912c0609 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106299 Jul 29 05:04:24.139517 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 610/1214] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:04:24.461498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:24.462194 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:24.468331 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:24.469135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:24.469936 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:24.470359 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:24.600333 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:24.607828 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-325136b2-a7a1-44dc-a871-04958da7d895 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.150392 Jul 29 05:04:24.608395 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 605/1215] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:24 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:24.936035 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:24.936884 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:24.943390 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:24.943838 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:24.944631 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:24.945075 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:24.959752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] HTTP exception thrown: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Request method failure captured: Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 HTTP/1.1 Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42mbmJRtFFQLgZeBGjMhIG8M_5rIpNnBkN_0gr5GbOOAzDdgt_1cSae0ZH9T3ef8oq0mr46NWDxhAbRceFZCC0-4kHTzOwyQLlDL7ku4AknrsF1YAdkIRoDPpwjBP2EtCOAMulUUF2xiaxC-uyOLkr8UY84ZjkmxVJ0sh6iINUrAAyI Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:04:24.961432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-TestVolumeBootPattern-357577197 Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 6fd1b82319424fb8bd7e50bc0cb00037 Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:04:24.963042 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '65045a08-7888-448b-b52a-67750317b2d1'} Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:04:24.963982 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:04:24.965480 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:04:24.967033 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Returning 404 to user: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:04:24.967033 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-02ab7079-76ee-4542-a4a5-9591bfcfd0ff tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 404 len: 111 microversion: 2.1 time: 0.031271 Jul 29 05:04:24.967033 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 611/1216] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:24 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:04:25.013086 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1304676311", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-262120479", "security_groups": [{"name": "tempest-secgroup-smoke-2066975548"}], "block_device_mapping_v2": [{"uuid": "4267a99f-9f81-41b9-b188-421543e01068", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8d51233-0dc5-4999-a537-b5dd4b1ae8b7"}]}} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:25.139287 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.network.neutron [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] validate_networks() for [('a8d51233-0dc5-4999-a537-b5dd4b1ae8b7', None, None, None, None, None)] {{(pid=129683) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:04:25.154723 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-c9772d81-5d9a-4fa9-b744-a4d812b55c1e req-996fba60-ecfe-42a1-a1d8-a46836ad747e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8b3fba-7def-4a73-9c76-0b4871f244e9", "name": "network-vif-plugged", "status": "completed", "tag": "1a26b861-617c-4ef6-b856-a16b66ee0360"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:25.164857 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-c9772d81-5d9a-4fa9-b744-a4d812b55c1e req-996fba60-ecfe-42a1-a1d8-a46836ad747e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:25.165307 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-c9772d81-5d9a-4fa9-b744-a4d812b55c1e req-996fba60-ecfe-42a1-a1d8-a46836ad747e service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:25.177936 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-c9772d81-5d9a-4fa9-b744-a4d812b55c1e req-996fba60-ecfe-42a1-a1d8-a46836ad747e service nova] Creating event network-vif-plugged:1a26b861-617c-4ef6-b856-a16b66ee0360 for instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 on hv-cinder-85144 Jul 29 05:04:25.182938 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-c9772d81-5d9a-4fa9-b744-a4d812b55c1e req-996fba60-ecfe-42a1-a1d8-a46836ad747e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031829 Jul 29 05:04:25.183552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 612/1217] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:04:25.526079 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Flavor limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:04:25.526512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Image limits 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:04:25.526994 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Flavor pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:04:25.527415 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Image pref 0:0:0 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:04:25.527835 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.virt.hardware [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129683) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:04:25.537414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:25.537859 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:25.538664 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:25.539106 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:25.556366 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:04:25.560312 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.quota [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for user 6fd1b82319424fb8bd7e50bc0cb00037 and project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'cores', 'instances', 'ram'} {{(pid=129683) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:04:25.615772 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Going to run 1 instances... {{(pid=129683) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:04:25.617918 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4267a99f-9f81-41b9-b188-421543e01068',volume_size=None,volume_type=None)] {{(pid=129683) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:04:25.633751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:25.634462 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:25.640844 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:25.641305 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:25.642086 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:25.642528 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:25.756734 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-760fb56a-e4b0-40e3-9221-0179403d69b8 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747520 Jul 29 05:04:25.757380 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 606/1218] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 05:04:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:04:25.768539 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-b78d903e-3cd9-48fb-a73c-29bb8c25c604 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:25.769794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-b78d903e-3cd9-48fb-a73c-29bb8c25c604 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:25.787175 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:25.797345 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-8b579cb5-3bcc-41fa-8460-713efbfb49b3 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.167554 Jul 29 05:04:25.798017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 613/1219] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:25 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:04:25.829167 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-b78d903e-3cd9-48fb-a73c-29bb8c25c604 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:25.835875 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-b78d903e-3cd9-48fb-a73c-29bb8c25c604 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1094 microversion: 2.1 time: 0.071558 Jul 29 05:04:25.836442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 607/1220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:25 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:26.820265 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:26.820900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:26.827495 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:26.827951 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:26.828750 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:26.829197 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:26.855296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:26.856209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:26.869631 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:26.870091 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:26.870869 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:26.871312 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:26.934760 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:26.942625 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4a985f17-ea29-4e41-bc54-c2c3ba3a4557 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1192 microversion: 2.1 time: 0.091192 Jul 29 05:04:26.943915 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 608/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:26 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:04:26.965554 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:26.973227 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5a572828-de67-4637-8f3b-818a2bd9a0eb tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1574 microversion: 2.1 time: 0.157741 Jul 29 05:04:26.973815 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 614/1222] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:26 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:27.964718 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:27.965509 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:27.972051 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:27.972502 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:27.973577 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:27.973921 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:27.994818 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:27.995497 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:28.002141 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:28.002907 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:28.004034 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:28.004736 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:28.048299 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:28.057511 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e39a8418-b161-44b2-9a3a-75b378f8ca33 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1210 microversion: 2.1 time: 0.096958 Jul 29 05:04:28.071453 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 609/1223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:27 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:28.213549 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:28.225693 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-fa69f172-791b-475f-b3ed-dcfa7091566f tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1561 microversion: 2.1 time: 0.233257 Jul 29 05:04:28.226513 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 615/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:27 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:04:29.080354 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:29.081903 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:29.090196 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:29.090976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:29.091853 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:29.092690 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:29.202568 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-eec8b4f7-e965-4908-8b29-4c8c82e6e757 req-cfbd1cdc-5222-4505-9e16-be909da24321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbad7c12-17df-4d94-b965-28b5daa8d3eb", "tag": "8377000e-a189-4cb7-8339-f67e9ffaba23"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:29.224046 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-eec8b4f7-e965-4908-8b29-4c8c82e6e757 req-cfbd1cdc-5222-4505-9e16-be909da24321 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:29.224046 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-eec8b4f7-e965-4908-8b29-4c8c82e6e757 req-cfbd1cdc-5222-4505-9e16-be909da24321 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:29.240296 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-eec8b4f7-e965-4908-8b29-4c8c82e6e757 req-cfbd1cdc-5222-4505-9e16-be909da24321 service nova] Creating event network-changed:8377000e-a189-4cb7-8339-f67e9ffaba23 for instance fbad7c12-17df-4d94-b965-28b5daa8d3eb on hv-cinder-85144 Jul 29 05:04:29.245362 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-eec8b4f7-e965-4908-8b29-4c8c82e6e757 req-cfbd1cdc-5222-4505-9e16-be909da24321 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046571 Jul 29 05:04:29.249730 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 616/1225] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:04:29.259993 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:29.267814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-495e62c6-f580-4aac-9af7-6c7c74301807 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.192410 Jul 29 05:04:29.268497 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 610/1226] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:29 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:30.291457 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:30.292070 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:30.298577 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:30.299025 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:30.299775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:30.300210 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:30.433665 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:30.441182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-afd7650a-92d8-4941-a599-b8521cfa1a01 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.154521 Jul 29 05:04:30.441752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 617/1227] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:30 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:31.462124 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:31.462806 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:31.469300 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:31.469756 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:31.470532 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:31.470976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:31.605209 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:31.612716 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-45ef0844-d04a-4695-a0f6-f7c0e8572e89 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.155147 Jul 29 05:04:31.613290 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 611/1228] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:31 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:32.635087 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:32.635727 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:32.642591 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:32.643321 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:32.644100 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:32.644843 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:32.798452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:32.807806 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-e5c82f67-f5ec-4f2f-bfdb-78b1e9a3c93f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.177131 Jul 29 05:04:32.808387 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 618/1229] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:32 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:33.828890 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:33.829501 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:33.837037 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:33.837488 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:33.838250 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:33.838693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:33.970961 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:33.978555 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7870c091-67d1-46ee-ad47-cdafe217eaee tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.153623 Jul 29 05:04:33.979122 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 612/1230] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:33 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:34.999176 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:34.999798 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:35.006851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:35.007308 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:35.008074 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:35.008524 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:35.142109 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:35.150350 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-509f4015-c1d2-4f04-810f-bd3af585d739 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.155050 Jul 29 05:04:35.150928 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 619/1231] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:34 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:36.171157 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:36.172019 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:36.174357 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:04:36.175108 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=8 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:04:36.181336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:36.181794 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:36.182568 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:36.183009 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:36.315589 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:36.323739 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-16d08dd0-a9ce-4854-8d4b-00a79093380f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.156506 Jul 29 05:04:36.324308 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 613/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:36 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:37.344122 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:37.344833 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:37.351697 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:37.352154 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:37.352957 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:37.353396 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:37.483905 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:37.491421 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5a5178fd-6611-40d0-9807-cec640014dba tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.151155 Jul 29 05:04:37.491987 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 620/1233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:37 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:38.512368 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:38.513004 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:38.519575 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:38.520028 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:38.520839 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:38.521375 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:38.651487 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:38.658949 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-f6c4fa08-ed84-4f79-b9e2-edfea8c86fe4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.150545 Jul 29 05:04:38.659509 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 614/1234] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:38 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:39.680037 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:39.680687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:39.687448 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:39.687906 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:39.688711 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:39.689161 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:39.827339 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:39.836403 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-275d0688-9ce8-4d67-9698-30afd4e14d6f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.160347 Jul 29 05:04:39.837146 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 621/1235] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:39 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:40.857271 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:40.857882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:40.864371 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:40.864976 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:40.865741 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:40.866183 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:41.001379 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:41.009563 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-432ec1ab-f516-40eb-97f6-d5d51fbca3cd tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.156161 Jul 29 05:04:41.010130 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 615/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:40 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:41.330072 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-fa1bc9e1-2a52-4c25-a892-4f6616f38732 req-36a36f20-ec25-48e7-a1b3-c1481f1e8cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbad7c12-17df-4d94-b965-28b5daa8d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "8377000e-a189-4cb7-8339-f67e9ffaba23"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:41.341114 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-fa1bc9e1-2a52-4c25-a892-4f6616f38732 req-36a36f20-ec25-48e7-a1b3-c1481f1e8cf2 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:41.341570 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-fa1bc9e1-2a52-4c25-a892-4f6616f38732 req-36a36f20-ec25-48e7-a1b3-c1481f1e8cf2 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:41.352732 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-fa1bc9e1-2a52-4c25-a892-4f6616f38732 req-36a36f20-ec25-48e7-a1b3-c1481f1e8cf2 service nova] Creating event network-vif-plugged:8377000e-a189-4cb7-8339-f67e9ffaba23 for instance fbad7c12-17df-4d94-b965-28b5daa8d3eb on hv-cinder-85144 Jul 29 05:04:41.357647 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-fa1bc9e1-2a52-4c25-a892-4f6616f38732 req-36a36f20-ec25-48e7-a1b3-c1481f1e8cf2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031366 Jul 29 05:04:41.358461 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 622/1237] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:04:42.030980 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:42.031600 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:42.038571 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:42.039025 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:42.039812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:42.040251 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:42.168629 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:42.176289 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-eb53a918-a688-4fc4-98ec-bcba3e7b5a31 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1266 microversion: 2.1 time: 0.149203 Jul 29 05:04:42.176879 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 616/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:42 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:43.199570 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:43.200276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:43.206523 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:43.206981 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:43.207748 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:43.208731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:43.343611 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:43.351759 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-540c4bf3-d74b-449d-99da-cd8733065253 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1454 microversion: 2.1 time: 0.156934 Jul 29 05:04:43.352341 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 623/1239] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:43 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:04:43.372150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:04:43.372804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:04:43.379316 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:43.379777 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:43.380556 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:43.381034 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:43.516917 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:04:43.524871 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-3be65349-30a4-4c31-83f8-738b0bc1462e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1454 microversion: 2.1 time: 0.156502 Jul 29 05:04:43.525438 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 617/1240] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:04:43 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:04:45.122139 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-3e12a830-d333-4725-b3f6-94dbdcd9b2c8 req-e7fb521c-5301-4b38-91c2-495702410c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbad7c12-17df-4d94-b965-28b5daa8d3eb", "tag": "8377000e-a189-4cb7-8339-f67e9ffaba23"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:04:45.133012 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-3e12a830-d333-4725-b3f6-94dbdcd9b2c8 req-e7fb521c-5301-4b38-91c2-495702410c9b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:04:45.133452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-3e12a830-d333-4725-b3f6-94dbdcd9b2c8 req-e7fb521c-5301-4b38-91c2-495702410c9b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:04:45.144726 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-3e12a830-d333-4725-b3f6-94dbdcd9b2c8 req-e7fb521c-5301-4b38-91c2-495702410c9b service nova] Creating event network-changed:8377000e-a189-4cb7-8339-f67e9ffaba23 for instance fbad7c12-17df-4d94-b965-28b5daa8d3eb on hv-cinder-85144 Jul 29 05:04:45.150611 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-3e12a830-d333-4725-b3f6-94dbdcd9b2c8 req-e7fb521c-5301-4b38-91c2-495702410c9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031753 Jul 29 05:04:45.151532 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 624/1241] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:05:52.077442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:05:52.077931 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 05:05:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:06:04.199105 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:04.200570 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=73 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:04.202774 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=31 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:04.203629 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:04.206622 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:04.207014 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:04.208987 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-09086be6-0698-442e-827a-a39a678de88f req-32fa32f4-1cdd-4d53-8644-2c8d854088ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8b3fba-7def-4a73-9c76-0b4871f244e9", "tag": "1a26b861-617c-4ef6-b856-a16b66ee0360"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:06:04.215882 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:04.216334 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:04.217145 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:04.217585 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:04.219309 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-09086be6-0698-442e-827a-a39a678de88f req-32fa32f4-1cdd-4d53-8644-2c8d854088ff service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:04.219751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-09086be6-0698-442e-827a-a39a678de88f req-32fa32f4-1cdd-4d53-8644-2c8d854088ff service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:04.231833 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-09086be6-0698-442e-827a-a39a678de88f req-32fa32f4-1cdd-4d53-8644-2c8d854088ff service nova] Creating event network-changed:1a26b861-617c-4ef6-b856-a16b66ee0360 for instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 on hv-cinder-85144 Jul 29 05:06:04.237441 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-09086be6-0698-442e-827a-a39a678de88f req-32fa32f4-1cdd-4d53-8644-2c8d854088ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036813 Jul 29 05:06:04.238260 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 625/1242] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:06:04.244260 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:06:04.332722 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-065a9fb5-13bd-4687-ad9e-bd89a8e3534c tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 204 len: 0 microversion: 2.1 time: 0.135174 Jul 29 05:06:04.333917 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 618/1243] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 05:06:04 2022] DELETE /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:06:04.344570 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:04.345293 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:04.353381 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:04.353831 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:04.354623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:04.355091 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:04.525563 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:04.533186 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-f55d7909-3330-49dd-bc88-dbdd468cf5ef tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.192795 Jul 29 05:06:04.533761 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 626/1244] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:04 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:05.555460 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:05.556187 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:05.562747 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:05.563206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:05.563982 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:05.564427 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:05.699473 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:05.707077 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-4263a527-97a7-44ca-9aff-39064180f714 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1567 microversion: 2.1 time: 0.156564 Jul 29 05:06:05.707646 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 619/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:05 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:06.721474 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-9723ccb6-af2d-4f1b-9022-4dcea8bafa80 req-7212ed0a-4e2b-4dd5-bdc4-18cf75d6a589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8b3fba-7def-4a73-9c76-0b4871f244e9", "name": "network-vif-deleted", "tag": "1a26b861-617c-4ef6-b856-a16b66ee0360"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:06:06.730513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:06.731182 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:06.735017 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9723ccb6-af2d-4f1b-9022-4dcea8bafa80 req-7212ed0a-4e2b-4dd5-bdc4-18cf75d6a589 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:06.735601 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-9723ccb6-af2d-4f1b-9022-4dcea8bafa80 req-7212ed0a-4e2b-4dd5-bdc4-18cf75d6a589 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:06.737601 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:06.738062 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:06.738846 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:06.739319 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:06.749418 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-9723ccb6-af2d-4f1b-9022-4dcea8bafa80 req-7212ed0a-4e2b-4dd5-bdc4-18cf75d6a589 service nova] Creating event network-vif-deleted:1a26b861-617c-4ef6-b856-a16b66ee0360 for instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 on hv-cinder-85144 Jul 29 05:06:06.756288 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-9723ccb6-af2d-4f1b-9022-4dcea8bafa80 req-7212ed0a-4e2b-4dd5-bdc4-18cf75d6a589 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038316 Jul 29 05:06:06.757135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 627/1246] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:06:06.813171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead3628943944bbeabaa2e6a80b99f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b586a0d507ca497589a504f9e2d44574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:06.821437 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-63c004ec-458f-4435-bc27-d9f4d6da6e9e tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 200 len: 1381 microversion: 2.1 time: 0.095018 Jul 29 05:06:06.822006 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 620/1247] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:06 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 1381 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:06:07.843941 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:07.844635 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] [instance: 0d8b3fba-7def-4a73-9c76-0b4871f244e9] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:07.851452 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:07.851895 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:07.852687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:07.853126 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:07.866337 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] HTTP exception thrown: Instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 could not be found. Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Request method failure captured: Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 HTTP/1.1 Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42l52_1RfSLW3HsFNke6tx7ly8k_e7U1HGCDeY7z-h476EOYnBkRJHcKUfTLIrw2HLBSG0O6hlwCi19CYklwPqXElT4tpRYPcs4HW3oMdgPoHN5MGd-nYaZaSTumcUF20YsIeHZk44smp7pMIDGHkT76KzsCb6JGmvXUx7ajcQjiu7I Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: b586a0d507ca497589a504f9e2d44574 Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-TestShelveInstance-734917030 Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:06:07.867926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b586a0d507ca497589a504f9e2d44574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b586a0d507ca497589a504f9e2d44574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b586a0d507ca497589a504f9e2d44574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b586a0d507ca497589a504f9e2d44574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-TestShelveInstance-734917030 Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: b586a0d507ca497589a504f9e2d44574 Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-TestShelveInstance-734917030 Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-TestShelveInstance-734917030-project Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: ead3628943944bbeabaa2e6a80b99f74 Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-TestShelveInstance-734917030-project Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 could not be found. Jul 29 05:06:07.869786 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '0d8b3fba-7def-4a73-9c76-0b4871f244e9'} Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 could not be found. Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:06:07.870851 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 could not be found. Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 could not be found. Jul 29 05:06:07.872699 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:06:07.874325 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Returning 404 to user: Instance 0d8b3fba-7def-4a73-9c76-0b4871f244e9 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:06:07.874325 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-07229aac-9cce-4226-8926-19bf69fb1127 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9" status: 404 len: 111 microversion: 2.1 time: 0.029741 Jul 29 05:06:07.874325 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 628/1248] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:07 2022] GET /compute/v2.1/servers/0d8b3fba-7def-4a73-9c76-0b4871f244e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:06:08.029527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-a36790d7-0189-4bf1-8112-0c75dcc43919 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] Calling method '.version_select at 0x7f3c545bd430>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:08.054205 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-a36790d7-0189-4bf1-8112-0c75dcc43919 tempest-TestShelveInstance-734917030 tempest-TestShelveInstance-734917030-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1199785720" status: 202 len: 0 microversion: 2.1 time: 0.028399 Jul 29 05:06:08.055144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 621/1249] 10.222.0.40 () {58 vars in 1254 bytes} [Fri Jul 29 05:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1199785720 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:06:44.972006 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-414145524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-262120479", "security_groups": [{"name": "tempest-secgroup-smoke-2066975548"}], "block_device_mapping_v2": [{"uuid": "d6d8ebfb-4766-4e52-bd52-bd52353a1590", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8d51233-0dc5-4999-a537-b5dd4b1ae8b7"}]}} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:06:44.982482 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=8 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:44.983130 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=12 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:45.091603 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.network.neutron [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] validate_networks() for [('a8d51233-0dc5-4999-a537-b5dd4b1ae8b7', None, None, None, None, None)] {{(pid=129684) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 05:06:45.558375 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Flavor limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 05:06:45.558810 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Image limits 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 05:06:45.559294 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Flavor pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 05:06:45.559714 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Image pref 0:0:0 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 05:06:45.560135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.virt.hardware [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129684) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 05:06:45.569533 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:45.569989 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:45.570801 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:45.571250 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:45.587552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 05:06:45.591553 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.quota [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Getting quotas for user 6fd1b82319424fb8bd7e50bc0cb00037 and project e10af2e6edcd485caf51326fdc9c17fc. Resources: {'cores', 'instances', 'ram'} {{(pid=129684) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 05:06:45.647464 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Going to run 1 instances... {{(pid=129684) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 05:06:45.649590 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6d8ebfb-4766-4e52-bd52-bd52353a1590',volume_size=None,volume_type=None)] {{(pid=129684) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 05:06:45.776286 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-94954b59-c8c5-4008-bcb8-ba2037e2ef96 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808226 Jul 29 05:06:45.776977 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 629/1250] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Jul 29 05:06:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 05:06:45.785322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:45.786070 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:45.790822 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-afbd3c2b-ba46-47d2-b172-8dfe30f4bdf7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:45.791448 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-afbd3c2b-ba46-47d2-b172-8dfe30f4bdf7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:45.850715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-afbd3c2b-ba46-47d2-b172-8dfe30f4bdf7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:45.857537 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-afbd3c2b-ba46-47d2-b172-8dfe30f4bdf7 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1093 microversion: 2.1 time: 0.073728 Jul 29 05:06:45.858140 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 622/1251] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:45 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:46.885751 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:46.886369 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:46.892632 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:46.893101 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:46.893875 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:46.894322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:46.968163 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:46.976107 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-de12c791-4fde-4a55-a917-b72b04087327 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1209 microversion: 2.1 time: 0.094741 Jul 29 05:06:46.976703 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 630/1252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:46 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:47.997086 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:47.997978 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:48.004802 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:48.006229 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:48.007141 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:48.007689 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:48.148148 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:48.163895 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-1a570789-6a4e-4c13-a24a-21c9e01dd702 req-8d8fed89-4f80-4899-979b-1937049e735b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb088bf-3354-43e7-8e24-877fc877fd9c", "tag": "5c68983c-cfb3-4800-a355-b39022c12436"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:06:48.169356 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-ee43c0f1-b3a0-4de4-bcf8-257bf3bba909 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.167830 Jul 29 05:06:48.179833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 623/1253] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:47 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:48.180126 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-1a570789-6a4e-4c13-a24a-21c9e01dd702 req-8d8fed89-4f80-4899-979b-1937049e735b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:48.180126 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-1a570789-6a4e-4c13-a24a-21c9e01dd702 req-8d8fed89-4f80-4899-979b-1937049e735b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:48.194943 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-1a570789-6a4e-4c13-a24a-21c9e01dd702 req-8d8fed89-4f80-4899-979b-1937049e735b service nova] Creating event network-changed:5c68983c-cfb3-4800-a355-b39022c12436 for instance 5fb088bf-3354-43e7-8e24-877fc877fd9c on hv-cinder-85144 Jul 29 05:06:48.200464 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-1a570789-6a4e-4c13-a24a-21c9e01dd702 req-8d8fed89-4f80-4899-979b-1937049e735b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046222 Jul 29 05:06:48.201491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 631/1254] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:06:49.191102 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:49.191724 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:49.198804 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:49.199263 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:49.200068 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:49.200513 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:49.335708 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:49.343154 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e59e5661-879e-4a23-a7b6-bc21ecb0a1ac tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.155897 Jul 29 05:06:49.343718 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 624/1255] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:49 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:50.364780 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:50.365492 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:50.371745 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:50.372196 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:50.372991 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:50.373692 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:50.510386 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:50.517929 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-5a814356-a1c4-4bae-a97b-656568c38a5d tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.158173 Jul 29 05:06:50.518527 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 632/1256] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:50 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:51.539781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:51.540421 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:51.546908 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:51.547363 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:51.548379 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:51.548851 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:51.681661 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:51.689282 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-17df551b-0d1d-41aa-a23a-d2c2bd6699a2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.154520 Jul 29 05:06:51.689857 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 625/1257] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:51 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:52.710102 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:52.710718 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:52.717338 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:52.717793 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:52.718566 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:52.719011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:52.845920 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:52.854011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-c1239ca2-57a9-4c82-b658-a3f472437e41 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.148015 Jul 29 05:06:52.854584 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 633/1258] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:52 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:53.875277 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:53.875922 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:53.883811 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:53.884265 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:53.885087 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:53.885527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:54.014526 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:54.022150 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-af98284f-1ef9-4840-b8a2-f8854e24f83e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.150743 Jul 29 05:06:54.022715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 626/1259] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:53 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:55.042623 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:55.043224 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:55.049768 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:55.050220 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:55.050967 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:55.051403 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:55.181093 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:55.188627 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-38a51358-24df-460d-9652-655dad518105 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.149874 Jul 29 05:06:55.189195 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 634/1260] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:55 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:56.210217 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:56.210867 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:56.212927 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell0:SELECT=2 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:56.218740 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:56.219202 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:56.220020 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:56.220471 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:56.355069 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:56.362643 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-852f8ce4-aa72-4c92-b60f-4ca6e0f5f679 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.156380 Jul 29 05:06:56.363218 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 627/1261] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:56 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:57.383717 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:57.384322 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:57.386344 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=2 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:57.387016 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell0:SELECT=6 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:06:57.393441 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:57.393890 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:57.394646 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:57.395081 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:57.532900 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:57.540359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-d3761d1f-a324-47da-bea7-26bcbf3eddf2 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.161193 Jul 29 05:06:57.540950 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 635/1262] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:57 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:58.561960 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:58.562681 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:58.569373 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:58.569826 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:58.570588 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:58.571023 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:58.709812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:58.717284 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-60dde087-4f22-4ed4-a095-d04dfe5fddd9 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.159324 Jul 29 05:06:58.717844 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 628/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:58 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:06:59.738995 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:06:59.739619 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:06:59.746233 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:59.746731 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:59.747508 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:59.747956 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:59.831614 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [req-aec0022e-7378-4e17-b58c-7ab512859205 req-58efae28-fce1-47db-b54a-8f628427c0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb088bf-3354-43e7-8e24-877fc877fd9c", "name": "network-vif-plugged", "status": "completed", "tag": "5c68983c-cfb3-4800-a355-b39022c12436"}]} {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:06:59.844465 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-aec0022e-7378-4e17-b58c-7ab512859205 req-58efae28-fce1-47db-b54a-8f628427c0f3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:06:59.845024 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [req-aec0022e-7378-4e17-b58c-7ab512859205 req-58efae28-fce1-47db-b54a-8f628427c0f3 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:06:59.857528 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.compute.server_external_events [req-aec0022e-7378-4e17-b58c-7ab512859205 req-58efae28-fce1-47db-b54a-8f628427c0f3 service nova] Creating event network-vif-plugged:5c68983c-cfb3-4800-a355-b39022c12436 for instance 5fb088bf-3354-43e7-8e24-877fc877fd9c on hv-cinder-85144 Jul 29 05:06:59.862781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [req-aec0022e-7378-4e17-b58c-7ab512859205 req-58efae28-fce1-47db-b54a-8f628427c0f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Jul 29 05:06:59.863582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 629/1264] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:06:59.885874 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:06:59.893687 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9caf75b9-c4a3-42fd-9419-aca0dc24ed1e tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.158937 Jul 29 05:06:59.894263 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 636/1265] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:06:59 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:07:00.914723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:07:00.915383 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:07:00.922171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:07:00.922889 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:07:00.923688 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:07:00.924134 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:07:01.058814 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:07:01.066336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-8ed81e53-2359-4121-8e39-16343183a293 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1265 microversion: 2.1 time: 0.155954 Jul 29 05:07:01.066930 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 630/1266] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:07:00 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:07:02.088146 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:07:02.088773 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:07:02.095400 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:07:02.095606 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:07:02.096366 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:07:02.096824 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:07:02.225894 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:07:02.233342 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-46be04f0-f1ba-46ef-a19a-fd4a345c6cf1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1452 microversion: 2.1 time: 0.149826 Jul 29 05:07:02.233901 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 637/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:07:02 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:07:02.252940 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:07:02.253550 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:07:02.260619 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:07:02.261079 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:07:02.261837 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:07:02.262274 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:07:02.390152 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:07:02.398810 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-0138ccef-d3a7-4357-af36-890ed03d1cb4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1452 microversion: 2.1 time: 0.149619 Jul 29 05:07:02.399374 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 631/1268] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:07:02 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:07:04.122318 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-dc3a2269-6030-4b06-af8a-5e398dc80f16 req-b0c4c452-eb2c-4b26-81e9-a1d7275feff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb088bf-3354-43e7-8e24-877fc877fd9c", "tag": "5c68983c-cfb3-4800-a355-b39022c12436"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:07:04.132372 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-dc3a2269-6030-4b06-af8a-5e398dc80f16 req-b0c4c452-eb2c-4b26-81e9-a1d7275feff0 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:07:04.132848 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-dc3a2269-6030-4b06-af8a-5e398dc80f16 req-b0c4c452-eb2c-4b26-81e9-a1d7275feff0 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:07:04.143552 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-dc3a2269-6030-4b06-af8a-5e398dc80f16 req-b0c4c452-eb2c-4b26-81e9-a1d7275feff0 service nova] Creating event network-changed:5c68983c-cfb3-4800-a355-b39022c12436 for instance 5fb088bf-3354-43e7-8e24-877fc877fd9c on hv-cinder-85144 Jul 29 05:07:04.149349 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-dc3a2269-6030-4b06-af8a-5e398dc80f16 req-b0c4c452-eb2c-4b26-81e9-a1d7275feff0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186203 Jul 29 05:07:04.150019 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 638/1269] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 05:07:31.667723 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:07:31.668272 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 05:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:07:36.240679 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:07:36.241205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:08:56.183028 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4cc2955-a473-4ccb-9ceb-bd2b9d6452b6] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 05:08:56.187171 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:08:56.187700 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:08:56.187824 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:08:56.188513 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG dbcounter [-] [129684] Writing DB stats nova_cell1:SELECT=48 {{(pid=129684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:08:56.190527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bccb451-faf5-4b70-b731-d80bb9097efe] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 05:08:56.191199 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_api:SELECT=22 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:08:56.192110 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG dbcounter [-] [129683] Writing DB stats nova_cell1:SELECT=50 {{(pid=129683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 05:08:56.192926 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-73e882de-d8ed-41ad-be74-d47fb7c3cc06 req-39fa0d3b-646b-482f-b97d-cf060d7d892b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb088bf-3354-43e7-8e24-877fc877fd9c", "tag": "5c68983c-cfb3-4800-a355-b39022c12436"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:08:56.198289 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:56.198737 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:56.199691 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:56.200296 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:56.204790 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-73e882de-d8ed-41ad-be74-d47fb7c3cc06 req-39fa0d3b-646b-482f-b97d-cf060d7d892b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:56.205252 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-73e882de-d8ed-41ad-be74-d47fb7c3cc06 req-39fa0d3b-646b-482f-b97d-cf060d7d892b service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:56.216975 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-73e882de-d8ed-41ad-be74-d47fb7c3cc06 req-39fa0d3b-646b-482f-b97d-cf060d7d892b service nova] Creating event network-changed:5c68983c-cfb3-4800-a355-b39022c12436 for instance 5fb088bf-3354-43e7-8e24-877fc877fd9c on hv-cinder-85144 Jul 29 05:08:56.222592 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-73e882de-d8ed-41ad-be74-d47fb7c3cc06 req-39fa0d3b-646b-482f-b97d-cf060d7d892b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040858 Jul 29 05:08:56.223618 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 639/1270] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:08:56.227674 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:08:56.320206 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-e6d1dde0-b152-4503-9ca9-dd920017d936 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 204 len: 0 microversion: 2.1 time: 0.140740 Jul 29 05:08:56.320740 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 632/1271] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 05:08:56 2022] DELETE /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:08:56.329510 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:08:56.330210 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:08:56.336849 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:56.337314 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:56.338276 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:56.338585 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:56.541428 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:08:56.549388 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-9eed2a5e-1a1c-4c18-bb17-4676ae240616 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1576 microversion: 2.1 time: 0.224210 Jul 29 05:08:56.560791 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 640/1272] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:08:56 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 05:08:57.572715 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:08:57.573431 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:08:57.580783 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:57.581279 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:57.582064 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:57.582498 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:57.600738 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bccb451-faf5-4b70-b731-d80bb9097efe] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 54518. Jul 29 05:08:57.775670 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:08:57.783161 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-30bf815e-4bbb-405c-8c7e-9e681799c85f tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1576 microversion: 2.1 time: 0.215364 Jul 29 05:08:57.783728 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 633/1273] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:08:57 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:08:58.682239 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-8625926d-0945-44f1-b193-556065649cf0 req-090da620-a755-4ae0-9251-eeafd2fcf3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb088bf-3354-43e7-8e24-877fc877fd9c", "name": "network-vif-deleted", "tag": "5c68983c-cfb3-4800-a355-b39022c12436"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:08:58.697945 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-8625926d-0945-44f1-b193-556065649cf0 req-090da620-a755-4ae0-9251-eeafd2fcf3b6 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:58.698491 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-8625926d-0945-44f1-b193-556065649cf0 req-090da620-a755-4ae0-9251-eeafd2fcf3b6 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:58.711819 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-8625926d-0945-44f1-b193-556065649cf0 req-090da620-a755-4ae0-9251-eeafd2fcf3b6 service nova] Creating event network-vif-deleted:5c68983c-cfb3-4800-a355-b39022c12436 for instance 5fb088bf-3354-43e7-8e24-877fc877fd9c on hv-cinder-85144 Jul 29 05:08:58.716770 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-8625926d-0945-44f1-b193-556065649cf0 req-090da620-a755-4ae0-9251-eeafd2fcf3b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039690 Jul 29 05:08:58.717359 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 641/1274] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:08:58.804594 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:08:58.805243 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:08:58.811701 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:58.812160 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:58.812964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:58.813414 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:58.879964 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:08:58.888234 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-860c191a-8bac-4968-b87d-3283772280d4 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 200 len: 1224 microversion: 2.1 time: 0.087581 Jul 29 05:08:58.888783 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 634/1275] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:08:58 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:08:59.906947 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4cc2955-a473-4ccb-9ceb-bd2b9d6452b6] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 54526. Jul 29 05:08:59.911068 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:08:59.912335 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 5fb088bf-3354-43e7-8e24-877fc877fd9c] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:08:59.922103 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:59.922865 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:59.923660 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:08:59.924190 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:08:59.938807 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] HTTP exception thrown: Instance 5fb088bf-3354-43e7-8e24-877fc877fd9c could not be found. Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Request method failure captured: Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c HTTP/1.1 Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42mbmJRtFFQLgZeBGjMhIG8M_5rIpNnBkN_0gr5GbOOAzDdgt_1cSae0ZH9T3ef8oq0mr46NWDxhAbRceFZCC0-4kHTzOwyQLlDL7ku4AknrsF1YAdkIRoDPpwjBP2EtCOAMulUUF2xiaxC-uyOLkr8UY84ZjkmxVJ0sh6iINUrAAyI Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:08:59.940504 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-TestVolumeBootPattern-357577197 Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 6fd1b82319424fb8bd7e50bc0cb00037 Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 5fb088bf-3354-43e7-8e24-877fc877fd9c could not be found. Jul 29 05:08:59.942376 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '5fb088bf-3354-43e7-8e24-877fc877fd9c'} Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb088bf-3354-43e7-8e24-877fc877fd9c could not be found. Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:08:59.944182 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb088bf-3354-43e7-8e24-877fc877fd9c could not be found. Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb088bf-3354-43e7-8e24-877fc877fd9c could not be found. Jul 29 05:08:59.946932 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:08:59.949476 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Returning 404 to user: Instance 5fb088bf-3354-43e7-8e24-877fc877fd9c could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:08:59.949476 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-cf41e21c-d61d-46a6-82b7-c22e74b0d385 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c" status: 404 len: 111 microversion: 2.1 time: 0.036144 Jul 29 05:08:59.949476 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 642/1276] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:08:59 2022] GET /compute/v2.1/servers/5fb088bf-3354-43e7-8e24-877fc877fd9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:09:03.216886 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:03.217781 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:09:03.218598 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-41483e12-7ddc-419e-998a-0571d79ad574 req-c04c202a-919d-4834-a69f-9d33cc785c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbad7c12-17df-4d94-b965-28b5daa8d3eb", "tag": "8377000e-a189-4cb7-8339-f67e9ffaba23"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:09:03.224496 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:03.225278 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:03.226144 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:03.226658 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:03.228475 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-41483e12-7ddc-419e-998a-0571d79ad574 req-c04c202a-919d-4834-a69f-9d33cc785c37 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:03.228949 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-41483e12-7ddc-419e-998a-0571d79ad574 req-c04c202a-919d-4834-a69f-9d33cc785c37 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:03.240715 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-41483e12-7ddc-419e-998a-0571d79ad574 req-c04c202a-919d-4834-a69f-9d33cc785c37 service nova] Creating event network-changed:8377000e-a189-4cb7-8339-f67e9ffaba23 for instance fbad7c12-17df-4d94-b965-28b5daa8d3eb on hv-cinder-85144 Jul 29 05:09:03.245834 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-41483e12-7ddc-419e-998a-0571d79ad574 req-c04c202a-919d-4834-a69f-9d33cc785c37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030766 Jul 29 05:09:03.246436 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 643/1277] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:09:03.254079 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Going to try to terminate instance {{(pid=129683) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 05:09:03.338322 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-c0668957-80a7-4c9e-8b74-1d84f0c8affa tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 204 len: 0 microversion: 2.1 time: 0.124988 Jul 29 05:09:03.338951 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 635/1278] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 05:09:03 2022] DELETE /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 05:09:03.348138 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:03.349230 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:09:03.355752 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:03.356208 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:03.357015 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:03.357463 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:03.494861 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.policy [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129684) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:09:03.502559 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-df5d52f6-1a6f-4583-a775-7d5bf76c0659 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1579 microversion: 2.1 time: 0.158871 Jul 29 05:09:03.503135 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 644/1279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:09:03 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:09:04.524623 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:04.525336 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:09:04.532015 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:04.532463 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:04.533264 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:04.533730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:04.669101 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:09:04.677213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-72a0dd02-6d1c-42a2-b613-4e7f30a6e85a tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1579 microversion: 2.1 time: 0.157408 Jul 29 05:09:04.678384 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 636/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:09:04 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:09:05.579439 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [req-18cfcfe9-3297-4c1c-b073-696cb66223a4 req-56dceefe-d0f7-40ba-92ca-923f45673057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbad7c12-17df-4d94-b965-28b5daa8d3eb", "name": "network-vif-deleted", "tag": "8377000e-a189-4cb7-8339-f67e9ffaba23"}]} {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 05:09:05.590148 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-18cfcfe9-3297-4c1c-b073-696cb66223a4 req-56dceefe-d0f7-40ba-92ca-923f45673057 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:05.590613 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [req-18cfcfe9-3297-4c1c-b073-696cb66223a4 req-56dceefe-d0f7-40ba-92ca-923f45673057 service nova] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:05.602431 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.compute.server_external_events [req-18cfcfe9-3297-4c1c-b073-696cb66223a4 req-56dceefe-d0f7-40ba-92ca-923f45673057 service nova] Creating event network-vif-deleted:8377000e-a189-4cb7-8339-f67e9ffaba23 for instance fbad7c12-17df-4d94-b965-28b5daa8d3eb on hv-cinder-85144 Jul 29 05:09:05.607604 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [req-18cfcfe9-3297-4c1c-b073-696cb66223a4 req-56dceefe-d0f7-40ba-92ca-923f45673057 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031941 Jul 29 05:09:05.608205 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 645/1281] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Jul 29 05:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 05:09:05.699762 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:05.700379 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:09:05.707197 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:05.707730 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:05.708649 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:05.709117 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:05.769442 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.policy [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd1b82319424fb8bd7e50bc0cb00037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10af2e6edcd485caf51326fdc9c17fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129683) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 05:09:05.777221 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-9b040c38-910d-4aef-a67e-06a3782d29db tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 200 len: 1225 microversion: 2.1 time: 0.081416 Jul 29 05:09:05.777787 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 637/1282] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:09:05 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 05:09:06.800617 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:06.801336 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: fbad7c12-17df-4d94-b965-28b5daa8d3eb] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:09:06.808357 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:06.808832 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:06.809593 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:06.810026 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:06.823394 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] HTTP exception thrown: Instance fbad7c12-17df-4d94-b965-28b5daa8d3eb could not be found. Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Request method failure captured: Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb HTTP/1.1 Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42mbmJRtFFQLgZeBGjMhIG8M_5rIpNnBkN_0gr5GbOOAzDdgt_1cSae0ZH9T3ef8oq0mr46NWDxhAbRceFZCC0-4kHTzOwyQLlDL7ku4AknrsF1YAdkIRoDPpwjBP2EtCOAMulUUF2xiaxC-uyOLkr8UY84ZjkmxVJ0sh6iINUrAAyI Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:09:06.825003 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 6fd1b82319424fb8bd7e50bc0cb00037 Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance fbad7c12-17df-4d94-b965-28b5daa8d3eb could not be found. Jul 29 05:09:06.826749 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': 'fbad7c12-17df-4d94-b965-28b5daa8d3eb'} Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbad7c12-17df-4d94-b965-28b5daa8d3eb could not be found. Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:09:06.828011 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbad7c12-17df-4d94-b965-28b5daa8d3eb could not be found. Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbad7c12-17df-4d94-b965-28b5daa8d3eb could not be found. Jul 29 05:09:06.829775 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:06.831269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Returning 404 to user: Instance fbad7c12-17df-4d94-b965-28b5daa8d3eb could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:09:06.831269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-a116b30b-ef9b-4908-bcdd-22b742f2a7c1 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb" status: 404 len: 111 microversion: 2.1 time: 0.030841 Jul 29 05:09:06.831269 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 646/1283] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:09:06 2022] GET /compute/v2.1/servers/fbad7c12-17df-4d94-b965-28b5daa8d3eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:09:07.260527 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:07.261094 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.compute.api [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129683) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:09:07.267582 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:07.268035 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:07.268839 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:07.269281 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG oslo_concurrency.lockutils [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129683) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:07.282840 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.wsgi [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] HTTP exception thrown: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Request method failure captured: Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: request: DELETE /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 HTTP/1.1 Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept: application/json Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Accept-Encoding: identity Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Connection: close Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Length: 0 Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Content-Type: application/json Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Host: 10.222.0.40 Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Openstack-System-Scope: None Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: User-Agent: python-urllib3/1.26.10 Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Auth-Token: gAAAAABi42mbmJRtFFQLgZeBGjMhIG8M_5rIpNnBkN_0gr5GbOOAzDdgt_1cSae0ZH9T3ef8oq0mr46NWDxhAbRceFZCC0-4kHTzOwyQLlDL7ku4AknrsF1YAdkIRoDPpwjBP2EtCOAMulUUF2xiaxC-uyOLkr8UY84ZjkmxVJ0sh6iINUrAAyI Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Id: None Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Domain-Name: None Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Identity-Status: Confirmed Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Is-Admin-Project: True Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Id: default Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Domain-Name: Default Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Project-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Role: reader,member Jul 29 05:09:07.284489 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Roles: reader,member Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-Tenant-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Id: default Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Domain-Name: Default Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Id: 6fd1b82319424fb8bd7e50bc0cb00037 Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: X-User-Name: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: method: > Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: exception: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.286213 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: action_args: {'id': '65045a08-7888-448b-b52a-67750317b2d1'} Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:09:07.288172 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.289812 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.291512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Returning 404 to user: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. {{(pid=129683) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:09:07.291512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-7eaf4340-d500-45db-8c5f-da25f0410f10 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "DELETE /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 404 len: 111 microversion: 2.1 time: 0.029262 Jul 29 05:09:07.291512 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 638/1284] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Jul 29 05:09:07 2022] DELETE /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:09:07.295400 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '>' {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:07.296010 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.compute.api [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [instance: 65045a08-7888-448b-b52a-67750317b2d1] Fetching instance by UUID {{(pid=129684) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 05:09:07.302417 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:07.303029 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:07.303803 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 05:09:07.304257 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG oslo_concurrency.lockutils [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Lock "4aee4dd5-d750-4ce7-b7ef-1adbdadced01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129684) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 05:09:07.317432 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.wsgi [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] HTTP exception thrown: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Request method failure captured: Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: request: GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 HTTP/1.1 Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept: application/json Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Accept-Encoding: identity Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Connection: close Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Length: 0 Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Content-Type: application/json Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Host: 10.222.0.40 Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Openstack-System-Scope: None Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: User-Agent: python-urllib3/1.26.10 Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Auth-Token: gAAAAABi42mbmJRtFFQLgZeBGjMhIG8M_5rIpNnBkN_0gr5GbOOAzDdgt_1cSae0ZH9T3ef8oq0mr46NWDxhAbRceFZCC0-4kHTzOwyQLlDL7ku4AknrsF1YAdkIRoDPpwjBP2EtCOAMulUUF2xiaxC-uyOLkr8UY84ZjkmxVJ0sh6iINUrAAyI Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Id: None Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Domain-Name: None Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Identity-Status: Confirmed Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Is-Admin-Project: True Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Id: default Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Domain-Name: Default Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Project-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Role: reader,member Jul 29 05:09:07.319180 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Roles: reader,member Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e10af2e6edcd485caf51326fdc9c17fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}] Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Id: e10af2e6edcd485caf51326fdc9c17fc Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-Tenant-Name: tempest-TestVolumeBootPattern-357577197 Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Id: default Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Domain-Name: Default Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Id: 6fd1b82319424fb8bd7e50bc0cb00037 Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: X-User-Name: tempest-TestVolumeBootPattern-357577197-project Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: method: > Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: exception: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.321088 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: action_args: {'id': '65045a08-7888-448b-b52a-67750317b2d1'} Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: {{(pid=129684) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 05:09:07.322049 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. Jul 29 05:09:07.323657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: ERROR nova.api.openstack.wsgi Jul 29 05:09:07.325159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: DEBUG nova.api.openstack.wsgi [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Returning 404 to user: Instance 65045a08-7888-448b-b52a-67750317b2d1 could not be found. {{(pid=129684) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 05:09:07.325159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO nova.api.openstack.requestlog [None req-3267d695-efc0-41dc-95cf-4e5817796ae0 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1" status: 404 len: 111 microversion: 2.1 time: 0.029078 Jul 29 05:09:07.325159 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: [pid: 129684|app: 0|req: 647/1285] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Jul 29 05:09:07 2022] GET /compute/v2.1/servers/65045a08-7888-448b-b52a-67750317b2d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 05:09:08.616135 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: DEBUG nova.api.openstack.wsgi [None req-d9e37df8-f997-4488-ad64-68db73697a00 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] Calling method '.version_select at 0x7f3c5458bee0>' {{(pid=129683) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 05:09:08.620833 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9e37df8-f997-4488-ad64-68db73697a00 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [65862f0a-abe2-45e8-890b-366dfc938a72] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 05:09:09.628578 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9e37df8-f997-4488-ad64-68db73697a00 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] [65862f0a-abe2-45e8-890b-366dfc938a72] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 54582. Jul 29 05:09:09.647973 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO nova.api.openstack.requestlog [None req-d9e37df8-f997-4488-ad64-68db73697a00 tempest-TestVolumeBootPattern-357577197 tempest-TestVolumeBootPattern-357577197-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-262120479" status: 202 len: 0 microversion: 2.1 time: 1.036181 Jul 29 05:09:09.648562 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: [pid: 129683|app: 0|req: 639/1286] 10.222.0.40 () {58 vars in 1260 bytes} [Fri Jul 29 05:09:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-262120479 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 05:09:12.331841 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:09:12.332725 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:09:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:10:51.676955 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:10:51.677472 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 05:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:10:56.250044 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:10:56.250508 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:10:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:12:32.341463 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:12:32.342056 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:12:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:14:11.685699 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:14:11.686165 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 05:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:14:12.090693 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:14:12.090923 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 05:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:14:16.258823 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:14:16.259447 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:14:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:14:30.389180 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:14:30.389646 dv-cinder-851449-2-iscsi devstack@n-api.service[129683]: Fri Jul 29 05:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 05:14:32.706657 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 05:14:32.707120 dv-cinder-851449-2-iscsi devstack@n-api.service[129684]: Fri Jul 29 05:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!